Apr 09 13:26:52 devstack cinder-volume[72514]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 13:26:52 devstack cinder-volume[72514]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 13:26:52 devstack cinder-volume[72514]: we strongly recommend against using it for new projects.
Apr 09 13:26:52 devstack cinder-volume[72514]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 13:26:52 devstack cinder-volume[72514]: framework.  For more detail see
Apr 09 13:26:52 devstack cinder-volume[72514]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 13:26:52 devstack cinder-volume[72514]:   import eventlet  # noqa
Apr 09 13:26:53 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:26:53 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:26:53 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO dbcounter [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Registered counter for database cinder
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_db.sqlalchemy.engines [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG dbcounter [-] [72514] Writer thread running {{(pid=72514) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.rpc [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.rpc [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_db.sqlalchemy.engines [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.volume.manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Determined volume DB was empty at startup.
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG cinder.volume.manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72514) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.volume.manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING stevedore.named [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING castellan.key_manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING cinder.keymgr.conf_key_mgr [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG cinder.volume.drivers.lvm [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72514) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_concurrency.processutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72514) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_concurrency.processutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] CMD "cinder-rtstool verify" returned: 0 in 0.245s {{(pid=72514) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_db.sqlalchemy.engines [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.rpc [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.rpc [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING stevedore.named [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING castellan.key_manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO cinder.volume.manager [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_db.sqlalchemy.engines [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:26:54 devstack cinder-volume[72514]: INFO oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Starting 1 workers
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Started child 72617 {{(pid=72514) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Full set of CONF: {{(pid=72514) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] ******************************************************************************** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Configuration options gathered from: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] ================================================================================ {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] allow_availability_zone_fallback = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] allow_compression_on_image_upload = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] allowed_direct_url_schemes     = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] api_rate_limit                 = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] auth_strategy                  = keystone {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] az_cache_duration              = 3600 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72617]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_availability_zone      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_host                   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_name                   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_stats_polling_interval = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backup_api_class               = cinder.backup.api.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backup_name_template           = backup-%s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backup_use_same_host           = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backup_use_temp_snapshot       = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] chap_password                  = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] chap_username                  =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_internal_tenant_project_id = 4e933ddc8a324499a9c8bc52dce1d391 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_internal_tenant_user_id = e443f5123ede41faa7d1f4e00229cfd1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cloned_volume_same_az          = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cluster                        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] compression_format             = gzip {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] config_dir                     = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] config_source                  = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] control_exchange               = openstack {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] debug                          = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] default_availability_zone      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] default_group_type             = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] default_volume_type            = lvmdriver-1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] disk_geometry                  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_client_cert             = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_client_cert_key         = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_data_namespace          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_ssl_cert_path           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_ssl_cert_verify         = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] driver_use_ssl                 = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] enable_force_upload            = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] enable_new_services            = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] enable_unsupported_driver      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] enforce_multipath_for_image_xfer = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] filter_function                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_api_insecure            = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_api_ssl_compression     = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_ca_certificates_file    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_certfile                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_keyfile                 = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_num_retries             = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance_request_timeout         = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] goodness_function              = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] graceful_shutdown_timeout      = 5 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] group_api_class                = cinder.group.api.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] host                           = devstack {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_compress_on_upload       = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_conversion_address_space_limit = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_conversion_cpu_limit     = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_conversion_disable       = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_upload_use_cinder_backend = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_upload_use_internal_tenant = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_volume_cache_enabled     = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_volume_cache_max_count   = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] image_volume_cache_max_size_gb = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] init_host_max_objects_retrieval = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iscsi_target_flags             =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iscsi_write_cache              = on {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iser_helper                    = tgtadm {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iser_ip_address                = 192.168.122.132 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iser_port                      = 3260 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_color                      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_config_append              = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_dir                        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_file                       = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_options                    = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_rotate_interval            = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_rotate_interval_type       = days {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] log_rotation_type              = none {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] max_age                        = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] max_logfile_count              = 30 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] max_logfile_size_mb            = 200 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] max_over_subscription_ratio    = 20.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] message_reap_interval          = 86400 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] message_ttl                    = 2592000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] migration_create_volume_timeout_secs = 300 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] monkey_patch                   = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] monkey_patch_modules           = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] my_ip                          = 192.168.122.132 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] no_snapshot_gb_quota           = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] num_iser_scan_tries            = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] num_shell_tries                = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] num_volume_device_scan_tries   = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] nvmeof_conn_info_version       = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] nvmet_ns_id                    = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] nvmet_port_id                  = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_max_limit                = 1000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_ext_list          = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_listen_port       = 8776 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_use_ssl           = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] osapi_volume_workers           = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] per_volume_size_limit          = -1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] periodic_fuzzy_delay           = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] periodic_interval              = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] public_endpoint                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] publish_errors                 = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_backup_gigabytes         = 1000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_backups                  = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_gigabytes                = 1000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_groups                   = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_snapshots                = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] quota_volumes                  = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] rate_limit_burst               = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] rate_limit_except_level        = CRITICAL {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] rate_limit_interval            = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] reinit_driver_count            = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] replication_device             = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] report_discard_supported       = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] report_interval                = 120 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] reservation_clean_interval     = 86400 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] reservation_expire             = 86400 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] reserved_image_namespaces      = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] reserved_percentage            = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] rpc_response_timeout           = 120 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] run_external_periodic_tasks    = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] scst_target_driver             = iscsi {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] scst_target_iqn_name           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_down_time              = 720 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] shell_completion               = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] snapshot_name_template         = snapshot-%s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] snapshot_same_host             = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] split_loggers                  = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] state_path                     = /opt/stack/data/cinder {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] storage_availability_zone      = nova {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] storage_protocol               = iSCSI {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] syslog_log_facility            = LOG_USER {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_helper                  = lioadm {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_ip_address              = 192.168.122.132 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_port                    = 3260 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_protocol                = iscsi {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] target_secondary_ip_addresses  = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] trace_flags                    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] transport_url                  = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] until_refresh                  = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_chap_auth                  = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_default_quota_class        = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_journal                    = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_json                       = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_multipath_for_image_xfer   = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_stderr                     = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] use_syslog                     = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] verify_glance_signatures       = enabled {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_api_class               = cinder.volume.api.API {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_backend_name            = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_clear                   = zero {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_clear_ionice            = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_clear_size              = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_copy_bps_limit          = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_dd_blocksize            = 1M {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_name_template           = volume-%s {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_service_inithost_offload = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volume_usage_audit_period      = month {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] zoning_mode                    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72617]: INFO cinder.volume.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_concurrency.disable_process_locking = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.admin_password = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.admin_token = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.admin_user  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_protocol = https {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_section = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_type   = password {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_uri    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.auth_version = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.cache       = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.certfile    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.identity_uri = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.include_service_catalog = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.insecure    = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.interface   = public {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.keyfile     = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_password =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcache_username =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.region_name = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.service_type = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.backend                  = dogpile.cache.null {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.backend_argument         = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.backend_expiration_time  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.config_prefix            = cache.oslo {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.debug_cache_backend      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.enable_retry_client      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.enable_socket_keepalive  = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.enabled                  = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.enforce_fips_mode        = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.expiration_time          = 600 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.hashclient_retry_attempts = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_dead_retry      = 300 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_sasl_enabled    = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.password                 = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.proxies                  = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.redis_db                 = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.redis_server             = localhost:6379 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.retry_attempts           = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.retry_delay              = 0.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.socket_keepalive_count   = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.socket_keepalive_idle    = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.socket_keepalive_interval = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.socket_timeout           = 1.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.tls_allowed_ciphers      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.tls_cafile               = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.tls_certfile             = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.tls_enabled              = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.tls_keyfile              = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cache.username                 = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] coordination.backend_url       = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.asyncio_connection    = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.asyncio_slave_connection = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.backend               = sqlalchemy {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.connection            = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.connection_debug      = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.connection_parameters =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.connection_recycle_time = 3600 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.connection_trace      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.db_inc_retry_interval = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.db_max_retries        = 20 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.db_max_retry_interval = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.db_retry_interval     = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.max_overflow          = 50 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.max_pool_size         = 5 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.max_retries           = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.mysql_wsrep_sync_wait = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.pool_timeout          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.retry_interval        = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.slave_connection      = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.sqlite_synchronous    = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.synchronous_reader    = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] database.use_db_reconnect      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.connection_string     = messaging:// {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.enabled               = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.es_doc_type           = notification {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.es_scroll_size        = 10000 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.es_scroll_time        = 2m {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.filter_error_trace    = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.hmac_keys             = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.sentinel_service_name = mymaster {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.socket_timeout        = 0.1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.trace_requests        = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler.trace_sqlalchemy      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler_jaeger.process_tags   = {} {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler_jaeger.service_name_prefix = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] profiler_otlp.service_name_prefix = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.enforce_new_defaults = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: WARNING oslo_config.cfg [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.enforce_scope      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.policy_default_rule = default {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.group          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.helper_command = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] privsep_osbrick.user           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.group         = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.helper_command = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] cinder_sys_admin.user          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.auth_section      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.auth_type         = password {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.cafile            = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.certfile          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.collect_timing    = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.insecure          = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.keyfile           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.send_service_user_token = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.split_loggers     = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] service_user.timeout           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.auth_section            = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.auth_type               = password {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.certfile                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.collect_timing          = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.insecure                = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.keyfile                 = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.region_name             = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.split_loggers           = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] glance.timeout                 = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.backend_availability_zone = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.chap_password = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.chap_username =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.disk_geometry = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_client_cert = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_client_cert_key = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_data_namespace = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.driver_use_ssl = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.extra_capabilities = {} {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.filter_function = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.goodness_function = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iscsi_target_flags =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iscsi_write_cache = on {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iser_port     = 3260 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.lvm_share_target = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.lvm_type      = auto {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.num_shell_tries = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.replication_device = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.report_discard_supported = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.reserved_percentage = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_helper = tgtadm {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_port   = 3260 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_protocol = iscsi {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.trace_flags   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.unique_fqdn_network = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.use_chap_auth = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_backend_name = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_clear  = zero {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_clear_ionice = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_clear_size = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_reports.file_event_handler = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_reports.log_dir           = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.backend_host       = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.chap_password      = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.chap_username      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.disk_geometry      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_client_cert = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.extra_capabilities = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.filter_function    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.goodness_function  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iser_helper        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iser_port          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.lvm_type           = auto {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.replication_device = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.report_discard_supported = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.reserved_percentage = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.scst_target_driver = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.storage_protocol   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_ip_address  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_port        = 3260 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.trace_flags        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_clear       = zero {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] lvmdriver-1.volumes_dir        = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_notifications.driver = [] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_notifications.retry = -1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] key_manager.fixed_key          = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.barbican_api_version  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.barbican_endpoint     = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.barbican_endpoint_type = public {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.barbican_region_name  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.cafile                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.certfile              = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.collect_timing        = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.insecure              = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.keyfile               = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.number_of_retries     = 60 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.retry_delay           = 1 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.send_service_user_token = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.split_loggers         = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.timeout               = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.verify_ssl            = True {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican.verify_ssl_path       = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.auth_section = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.auth_type = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.cafile   = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.certfile = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.collect_timing = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.insecure = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.keyfile  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.split_loggers = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] barbican_service_user.timeout  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.approle_role_id          = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.approle_secret_id        = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.kv_mountpoint            = secret {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.kv_path                  = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.kv_version               = 2 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.namespace                = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.root_token_id            = **** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.ssl_ca_crt_file          = None {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.timeout                  = 60.0 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.use_ssl                  = False {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:26:54 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] ******************************************************************************** {{(pid=72514) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:54 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:54 devstack sudo[72621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 09 13:26:54 devstack sudo[72621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:55 devstack sudo[72621]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:55 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.545s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:55 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:55 devstack sudo[72627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:26:55 devstack sudo[72627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:56 devstack sudo[72627]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.546s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:26:56 devstack cinder-volume[72617]: INFO cinder.brick.local_dev.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:56 devstack sudo[72835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:26:56 devstack sudo[72835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:56 devstack sudo[72835]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG cinder.brick.local_dev.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72617) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 09 13:26:56 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:56 devstack sudo[73051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:26:56 devstack sudo[73051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:57 devstack sudo[73051]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:57 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.292s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:57 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:57 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:57 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:57 devstack sudo[73293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:26:57 devstack sudo[73293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:58 devstack sudo[73293]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:58 devstack sudo[73317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 09 13:26:58 devstack sudo[73317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:58 devstack sudo[73317]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.450s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:58 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:58 devstack sudo[73320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:26:58 devstack sudo[73320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:59 devstack sudo[73320]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:59 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:59 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:59 devstack sudo[73326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:26:59 devstack sudo[73326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:26:59 devstack sudo[73326]: pam_unix(sudo:session): session closed for user root
Apr 09 13:26:59 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:26:59 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:26:59 devstack sudo[73332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:26:59 devstack sudo[73332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:00 devstack sudo[73332]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:00 devstack sudo[73337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:00 devstack sudo[73337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:00 devstack sudo[73337]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:00 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:00 devstack sudo[73341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:00 devstack sudo[73341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:01 devstack sudo[73341]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:01 devstack cinder-volume[72617]: INFO cinder.volume.drivers.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:01 devstack sudo[73448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:01 devstack sudo[73448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:01 devstack sudo[73448]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:27:01 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:01 devstack sudo[73467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:27:01 devstack sudo[73467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:02 devstack sudo[73467]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:02 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:02 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:02 devstack sudo[73566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:02 devstack sudo[73566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:02 devstack sudo[73566]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:02 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:02 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:02 devstack sudo[73608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:02 devstack sudo[73608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:03 devstack sudo[73608]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:03 devstack sudo[73611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:03 devstack sudo[73611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:03 devstack sudo[73611]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:03 devstack cinder-volume[72617]: INFO cinder.volume.driver [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG cinder.volume.driver [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72617) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG oslo_db.sqlalchemy.engines [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG dbcounter [-] [72617] Writer thread running {{(pid=72617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG cinder.db.sqlalchemy.api [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Building query based on filter {{(pid=72617) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG cinder.image.image_utils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72617) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 13:27:03 devstack cinder-volume[72617]: INFO cinder.keymgr.migration [None req-07a4382e-3bfa-4106-a5ce-c18703ac99ee None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:27:03 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:03 devstack sudo[73619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:27:03 devstack sudo[73619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:04 devstack sudo[73619]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:04 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:04 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:04 devstack sudo[73622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:04 devstack sudo[73622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:04 devstack sudo[73622]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:04 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:04 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:04 devstack sudo[73626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:04 devstack sudo[73626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:04 devstack cinder-volume[72514]: DEBUG dbcounter [-] [72514] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72514) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:27:05 devstack sudo[73626]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.564s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:05 devstack sudo[73633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:05 devstack sudo[73633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:05 devstack sudo[73633]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG cinder.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Notifying Schedulers of capabilities ... {{(pid=72617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:27:05 devstack cinder-volume[72617]: INFO cinder.volume.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Driver initialization completed successfully.
Apr 09 13:27:05 devstack cinder-volume[72617]: INFO cinder.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Initiating service 2 cleanup
Apr 09 13:27:05 devstack cinder-volume[72617]: INFO cinder.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Service 2 cleanup completed.
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG cinder.service [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Creating RPC server for service cinder-volume {{(pid=72617) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG cinder.service [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72617) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 13:27:05 devstack cinder-volume[72617]: INFO cinder.volume.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:27:05 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:05 devstack sudo[73642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:27:05 devstack sudo[73642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:06 devstack sudo[73642]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:06 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:06 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:06 devstack sudo[73645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:06 devstack sudo[73645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:06 devstack sudo[73645]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:06 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:06 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:06 devstack sudo[73702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:27:06 devstack sudo[73702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:07 devstack sudo[73702]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:07 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:07 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:27:07 devstack sudo[73705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:27:07 devstack sudo[73705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:27:07 devstack sudo[73705]: pam_unix(sudo:session): session closed for user root
Apr 09 13:27:07 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:27:07 devstack cinder-volume[72617]: INFO cinder.volume.manager [None req-625fbbba-9501-41d9-aa99-24db1a9cbc04 None None] Driver post RPC initialization completed successfully.
Apr 09 13:27:17 devstack cinder-volume[72617]: DEBUG dbcounter [-] [72617] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:27:17 devstack cinder-volume[72617]: DEBUG dbcounter [-] [72617] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:28:08 devstack cinder-volume[72617]: DEBUG oslo_service.periodic_task [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72617) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:28:08 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:28:08 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:28:08 devstack sudo[78437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:28:08 devstack sudo[78437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:28:09 devstack sudo[78437]: pam_unix(sudo:session): session closed for user root
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:28:09 devstack sudo[78441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:28:09 devstack sudo[78441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:28:09 devstack sudo[78441]: pam_unix(sudo:session): session closed for user root
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:28:09 devstack sudo[78444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:28:09 devstack sudo[78444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:28:09 devstack sudo[78444]: pam_unix(sudo:session): session closed for user root
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:28:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:28:09 devstack sudo[78447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:28:09 devstack sudo[78447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:28:10 devstack sudo[78447]: pam_unix(sudo:session): session closed for user root
Apr 09 13:28:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:28:10 devstack cinder-volume[72617]: DEBUG cinder.manager [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Notifying Schedulers of capabilities ... {{(pid=72617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:29:08 devstack cinder-volume[72617]: DEBUG oslo_service.periodic_task [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72617) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:29:08 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:29:08 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:29:08 devstack sudo[79717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:29:08 devstack sudo[79717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:29:09 devstack sudo[79717]: pam_unix(sudo:session): session closed for user root
Apr 09 13:29:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:29:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:29:09 devstack sudo[79737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:29:09 devstack sudo[79737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:29:09 devstack sudo[79737]: pam_unix(sudo:session): session closed for user root
Apr 09 13:29:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:29:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:29:09 devstack sudo[79761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:29:09 devstack sudo[79761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:29:10 devstack sudo[79761]: pam_unix(sudo:session): session closed for user root
Apr 09 13:29:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:29:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:29:10 devstack sudo[79767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:29:10 devstack sudo[79767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:29:10 devstack sudo[79767]: pam_unix(sudo:session): session closed for user root
Apr 09 13:29:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:29:10 devstack cinder-volume[72617]: DEBUG cinder.manager [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Notifying Schedulers of capabilities ... {{(pid=72617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:29:17 devstack cinder-volume[72617]: DEBUG dbcounter [-] [72617] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:30:08 devstack cinder-volume[72617]: DEBUG oslo_service.periodic_task [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72617) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:30:08 devstack cinder-volume[72617]: DEBUG cinder.volume.drivers.lvm [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Updating volume stats {{(pid=72617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 13:30:08 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:08 devstack sudo[81296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 13:30:08 devstack sudo[81296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:09 devstack sudo[81296]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:09 devstack sudo[81302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:30:09 devstack sudo[81302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:09 devstack sudo[81302]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:09 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:09 devstack sudo[81306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 13:30:09 devstack sudo[81306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:10 devstack sudo[81306]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:10 devstack sudo[81309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 13:30:10 devstack sudo[81309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:10 devstack sudo[81309]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:10 devstack cinder-volume[72617]: DEBUG oslo_concurrency.processutils [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:10 devstack cinder-volume[72617]: DEBUG cinder.manager [None req-c4688815-f0c3-40f9-b123-351c1bc1bf12 None None] Notifying Schedulers of capabilities ... {{(pid=72617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:30:27 devstack cinder-volume[72514]: INFO oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Caught SIGTERM, stopping children
Apr 09 13:30:27 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Acquiring lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:27 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Acquired lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:27 devstack cinder-volume[72514]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Releasing lock "singleton_lock" {{(pid=72514) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:27 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Stop services. {{(pid=72514) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 13:30:27 devstack cinder-volume[72514]: DEBUG oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Killing children. {{(pid=72514) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 13:30:27 devstack cinder-volume[72514]: INFO oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Waiting on 1 children to exit
Apr 09 13:30:30 devstack cinder-volume[72617]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Acquiring lock "singleton_lock" {{(pid=72617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:30 devstack cinder-volume[72617]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Acquired lock "singleton_lock" {{(pid=72617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:30 devstack cinder-volume[72617]: DEBUG oslo_concurrency.lockutils [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Releasing lock "singleton_lock" {{(pid=72617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:30 devstack cinder-volume[72617]: WARNING amqp [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 13:30:30 devstack cinder-volume[72617]: WARNING amqp [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 13:30:30 devstack cinder-volume[72514]: INFO oslo_service.backend._eventlet.service [None req-f9245944-70f4-4c54-8dca-a4d8f1ecda25 None None] Child 72617 exited with status 0
Apr 09 13:30:31 devstack cinder-volume[81835]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 13:30:31 devstack cinder-volume[81835]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 13:30:31 devstack cinder-volume[81835]: we strongly recommend against using it for new projects.
Apr 09 13:30:31 devstack cinder-volume[81835]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 13:30:31 devstack cinder-volume[81835]: framework.  For more detail see
Apr 09 13:30:31 devstack cinder-volume[81835]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 13:30:31 devstack cinder-volume[81835]:   import eventlet  # noqa
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO dbcounter [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Registered counter for database cinder
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG dbcounter [-] [81835] Writer thread running {{(pid=81835) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO cinder.rpc [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO cinder.rpc [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO cinder.volume.manager [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Determined volume DB was empty at startup.
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG cinder.volume.manager [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81835) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO cinder.volume.manager [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 13:30:33 devstack cinder-volume[81835]: WARNING stevedore.named [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 13:30:33 devstack cinder-volume[81835]: WARNING castellan.key_manager [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:30:33 devstack cinder-volume[81835]: WARNING cinder.keymgr.conf_key_mgr [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:30:33 devstack cinder-volume[81835]: INFO cinder.volume.manager [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 13:30:33 devstack cinder-volume[81835]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:34 devstack cinder-volume[81835]: INFO oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Starting 1 workers
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Started child 81957 {{(pid=81835) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Full set of CONF: {{(pid=81835) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] ******************************************************************************** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Configuration options gathered from: {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] ================================================================================ {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] allow_availability_zone_fallback = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] allow_compression_on_image_upload = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] allowed_direct_url_schemes     = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] api_rate_limit                 = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] auth_strategy                  = keystone {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_availability_zone      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_host                   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_name                   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_stats_polling_interval = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backup_api_class               = cinder.backup.api.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backup_name_template           = backup-%s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backup_use_same_host           = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backup_use_temp_snapshot       = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] chap_password                  = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] chap_username                  =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_internal_tenant_project_id = 4e933ddc8a324499a9c8bc52dce1d391 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_internal_tenant_user_id = e443f5123ede41faa7d1f4e00229cfd1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cluster                        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] compression_format             = gzip {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] config_dir                     = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] config_source                  = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] control_exchange               = openstack {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] debug                          = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] default_availability_zone      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] default_group_type             = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] default_volume_type            = QuobyteHD {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81957]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] disk_geometry                  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_client_cert             = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_client_cert_key         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_data_namespace          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_ssl_cert_path           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_ssl_cert_verify         = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] driver_use_ssl                 = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] enable_new_services            = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] enable_unsupported_driver      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] enforce_multipath_for_image_xfer = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] filter_function                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_api_insecure            = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_api_ssl_compression     = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_ca_certificates_file    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_certfile                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_keyfile                 = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_num_retries             = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance_request_timeout         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] goodness_function              = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] graceful_shutdown_timeout      = 5 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] group_api_class                = cinder.group.api.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] host                           = devstack {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_compress_on_upload       = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_conversion_address_space_limit = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_conversion_cpu_limit     = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_conversion_disable       = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_upload_use_cinder_backend = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_upload_use_internal_tenant = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_volume_cache_enabled     = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_volume_cache_max_count   = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] image_volume_cache_max_size_gb = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] init_host_max_objects_retrieval = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iscsi_target_flags             =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iscsi_write_cache              = on {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iser_helper                    = tgtadm {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iser_ip_address                = 192.168.122.132 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iser_port                      = 3260 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_color                      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_config_append              = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_dir                        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_file                       = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_options                    = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_rotate_interval            = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_rotate_interval_type       = days {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] log_rotation_type              = none {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] max_age                        = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] max_logfile_count              = 30 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] max_logfile_size_mb            = 200 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] max_over_subscription_ratio    = 20.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] message_reap_interval          = 86400 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] message_ttl                    = 2592000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] migration_create_volume_timeout_secs = 300 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] monkey_patch                   = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] monkey_patch_modules           = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] my_ip                          = 192.168.122.132 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] no_snapshot_gb_quota           = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] num_iser_scan_tries            = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] num_shell_tries                = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] num_volume_device_scan_tries   = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] nvmeof_conn_info_version       = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] nvmet_ns_id                    = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] nvmet_port_id                  = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_max_limit                = 1000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_ext_list          = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_listen_port       = 8776 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_use_ssl           = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] osapi_volume_workers           = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.remotefs [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81957) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] per_volume_size_limit          = -1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] periodic_fuzzy_delay           = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] periodic_interval              = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] public_endpoint                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] publish_errors                 = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_backup_gigabytes         = 1000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_backups                  = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_gigabytes                = 1000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_groups                   = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_snapshots                = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] quota_volumes                  = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] rate_limit_burst               = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] rate_limit_except_level        = CRITICAL {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] rate_limit_interval            = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] reinit_driver_count            = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] replication_device             = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] report_discard_supported       = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] report_interval                = 120 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] reservation_clean_interval     = 86400 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] reservation_expire             = 86400 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] reserved_image_namespaces      = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] reserved_percentage            = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] rpc_response_timeout           = 120 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] run_external_periodic_tasks    = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] scst_target_driver             = iscsi {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] scst_target_iqn_name           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_down_time              = 720 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] shell_completion               = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] snapshot_name_template         = snapshot-%s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] split_loggers                  = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] state_path                     = /opt/stack/data/cinder {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] storage_availability_zone      = nova {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] storage_protocol               = iSCSI {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] syslog_log_facility            = LOG_USER {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_helper                  = lioadm {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_ip_address              = 192.168.122.132 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_port                    = 3260 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_protocol                = iscsi {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] target_secondary_ip_addresses  = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] trace_flags                    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] transport_url                  = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] until_refresh                  = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_chap_auth                  = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_default_quota_class        = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_journal                    = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_json                       = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_multipath_for_image_xfer   = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_stderr                     = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] use_syslog                     = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] verify_glance_signatures       = enabled {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_api_class               = cinder.volume.api.API {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_backend_name            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_clear                   = zero {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_clear_ionice            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_clear_size              = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_copy_bps_limit          = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_dd_blocksize            = 1M {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_name_template           = volume-%s {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_service_inithost_offload = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volume_usage_audit_period      = month {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] zoning_mode                    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_concurrency.disable_process_locking = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.admin_password = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.admin_token = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.admin_user  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_protocol = https {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_section = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_type   = password {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_uri    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.auth_version = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.cache       = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.certfile    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.identity_uri = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.include_service_catalog = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.insecure    = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.interface   = public {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.keyfile     = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_password =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcache_username =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.region_name = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81957) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 13:30:34 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 13:30:34 devstack cinder-volume[81957]: WARNING cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.service_type = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Running cmd (subprocess): mount.quobyte {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.backend                  = dogpile.cache.null {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.backend_argument         = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.backend_expiration_time  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.config_prefix            = cache.oslo {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.debug_cache_backend      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.enable_retry_client      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.enable_socket_keepalive  = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.enabled                  = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.enforce_fips_mode        = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.expiration_time          = 600 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.hashclient_retry_attempts = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_dead_retry      = 300 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_sasl_enabled    = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.password                 = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.proxies                  = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.redis_db                 = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.redis_server             = localhost:6379 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.retry_attempts           = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.retry_delay              = 0.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.socket_keepalive_count   = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.socket_keepalive_idle    = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.socket_keepalive_interval = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.socket_timeout           = 1.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.tls_allowed_ciphers      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.tls_cafile               = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.tls_certfile             = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.tls_enabled              = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.tls_keyfile              = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cache.username                 = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] coordination.backend_url       = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.asyncio_connection    = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.asyncio_slave_connection = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.backend               = sqlalchemy {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.connection            = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.connection_debug      = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.connection_parameters =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.connection_recycle_time = 3600 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.connection_trace      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.db_inc_retry_interval = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.db_max_retries        = 20 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.db_max_retry_interval = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.db_retry_interval     = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.max_overflow          = 50 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.max_pool_size         = 5 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.max_retries           = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.mysql_wsrep_sync_wait = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.pool_timeout          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.retry_interval        = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.slave_connection      = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.sqlite_synchronous    = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.synchronous_reader    = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] database.use_db_reconnect      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.connection_string     = messaging:// {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.enabled               = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.es_doc_type           = notification {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.es_scroll_size        = 10000 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.es_scroll_time        = 2m {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.filter_error_trace    = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.hmac_keys             = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.sentinel_service_name = mymaster {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.socket_timeout        = 0.1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.trace_requests        = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler.trace_sqlalchemy      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler_jaeger.process_tags   = {} {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler_jaeger.service_name_prefix = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] profiler_otlp.service_name_prefix = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.enforce_new_defaults = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: WARNING oslo_config.cfg [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.enforce_scope      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.policy_default_rule = default {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.group          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.helper_command = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] privsep_osbrick.user           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.group         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.helper_command = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] cinder_sys_admin.user          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.auth_section      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.auth_type         = password {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.cafile            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.certfile          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.collect_timing    = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.insecure          = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.keyfile           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.send_service_user_token = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.split_loggers     = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] service_user.timeout           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.auth_section            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.auth_type               = password {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.certfile                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.collect_timing          = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.insecure                = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.keyfile                 = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.region_name             = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.split_loggers           = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] glance.timeout                 = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.backend_availability_zone = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.chap_password = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.chap_username =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.disk_geometry = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_client_cert = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_client_cert_key = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_data_namespace = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.driver_use_ssl = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.extra_capabilities = {} {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.filter_function = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.goodness_function = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack quobyte-client[81961]: Reading configuration file: /etc/quobyte/client.cfg
Apr 09 13:30:34 devstack quobyte-client[81961]: Invalid parameters found, error: missing mount point.
Apr 09 13:30:34 devstack quobyte-client[81961]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 09 13:30:34 devstack quobyte-client[81961]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iscsi_target_flags =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iscsi_write_cache = on {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iser_port     = 3260 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_host      =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_login     = admin {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_mount_options = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_password  = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_private_key =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_share_path =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.num_shell_tries = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.quobyte_volume_url = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: INFO cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 ...
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.replication_device = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f -c /etc/quobyte/client-cinder.cfg {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.report_discard_supported = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.reserved_percentage = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_helper = tgtadm {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_port   = 3260 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_protocol = iscsi {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.trace_flags   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.unique_fqdn_network = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.use_chap_auth = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_backend_name = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_clear  = zero {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_clear_ionice = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_clear_size = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_reports.file_event_handler = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_reports.log_dir           = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.backend_availability_zone = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.backend_host         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.chap_password        = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.chap_username        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack sudo[81962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f -c /etc/quobyte/client-cinder.cfg
Apr 09 13:30:34 devstack sudo[81962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.disk_geometry        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_client_cert   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_data_namespace = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.extra_capabilities   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.filter_function      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.goodness_function    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iser_helper          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iser_ip_address      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iser_port            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_host             = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_login            = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_mount_options    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_password         = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_private_key      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_share_path       = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.num_shell_tries      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.replication_device   = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.report_discard_supported = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.reserved_percentage  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.scst_target_driver   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.storage_protocol     = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_helper        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_ip_address    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_port          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_prefix        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_protocol      = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.trace_flags          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.use_chap_auth        = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_clear         = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_clear_size    = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] QuobyteHD.volumes_dir          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_notifications.driver = [] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_notifications.retry = -1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] key_manager.fixed_key          = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.barbican_api_version  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.barbican_endpoint     = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.barbican_endpoint_type = public {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.barbican_region_name  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.cafile                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.certfile              = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.collect_timing        = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.insecure              = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.keyfile               = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.number_of_retries     = 60 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.retry_delay           = 1 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.send_service_user_token = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.split_loggers         = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.timeout               = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.verify_ssl            = True {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican.verify_ssl_path       = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.auth_section = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.auth_type = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.cafile   = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.certfile = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.collect_timing = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.insecure = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.keyfile  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.split_loggers = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] barbican_service_user.timeout  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.approle_role_id          = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.approle_secret_id        = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.kv_mountpoint            = secret {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.kv_path                  = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.kv_version               = 2 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.namespace                = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.root_token_id            = **** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.ssl_ca_crt_file          = None {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.timeout                  = 60.0 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.use_ssl                  = False {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:34 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] ******************************************************************************** {{(pid=81835) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 13:30:34 devstack sudo[81962]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.478s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:34 devstack cinder-volume[81957]: INFO cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 succeeded
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:34 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:34 devstack sudo[82031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:34 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:35 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.388s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.volume.driver [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.volume.driver [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7143936157227, 'free_capacity_gb': 1775.7143936157227, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81957) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_db.sqlalchemy.engines [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG dbcounter [-] [81957] Writer thread running {{(pid=81957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.db.sqlalchemy.api [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Building query based on filter {{(pid=81957) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.image.image_utils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81957) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.keymgr.migration [None req-a1743ba8-c192-4947-b5ae-b791548d1827 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:35 devstack sudo[82036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:35 devstack sudo[82036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:35 devstack sudo[82036]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.406s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Driver initialization completed successfully.
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Initiating service 3 cleanup
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Service 3 cleanup completed.
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.service [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Creating RPC server for service cinder-volume {{(pid=81957) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.service [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81957) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 13:30:35 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:35 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:35 devstack sudo[82042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:35 devstack sudo[82042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:36 devstack sudo[82042]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:36 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.417s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:36 devstack cinder-volume[81957]: INFO cinder.volume.manager [None req-b58740a1-3767-4282-9b03-d5e5b3055234 None None] Driver post RPC initialization completed successfully.
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=81957) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG cinder.volume.drivers.quobyte [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=81957) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81957) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:39 devstack sudo[82107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:39 devstack sudo[82107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:39 devstack sudo[82107]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG oslo_concurrency.processutils [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.400s {{(pid=81957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:39 devstack cinder-volume[81957]: DEBUG cinder.manager [None req-46933e80-183b-44fe-aaca-398cf8b2cdac None None] Notifying Schedulers of capabilities ... {{(pid=81957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:30:42 devstack cinder-volume[81835]: INFO oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Caught SIGTERM, stopping children
Apr 09 13:30:42 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Acquiring lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:42 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Acquired lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:42 devstack cinder-volume[81835]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Releasing lock "singleton_lock" {{(pid=81835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:42 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Stop services. {{(pid=81835) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 13:30:42 devstack cinder-volume[81835]: DEBUG oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Killing children. {{(pid=81835) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 13:30:42 devstack cinder-volume[81835]: INFO oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Waiting on 1 children to exit
Apr 09 13:30:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Acquiring lock "singleton_lock" {{(pid=81957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Acquired lock "singleton_lock" {{(pid=81957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:43 devstack cinder-volume[81957]: DEBUG oslo_concurrency.lockutils [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Releasing lock "singleton_lock" {{(pid=81957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:43 devstack cinder-volume[81957]: WARNING amqp [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 13:30:43 devstack cinder-volume[81957]: WARNING amqp [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 13:30:43 devstack cinder-volume[81835]: INFO oslo_service.backend._eventlet.service [None req-0bf8a0a7-153e-4c3b-bf81-6fb3289cd474 None None] Child 81957 exited with status 0
Apr 09 13:30:44 devstack cinder-volume[82215]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 13:30:44 devstack cinder-volume[82215]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 13:30:44 devstack cinder-volume[82215]: we strongly recommend against using it for new projects.
Apr 09 13:30:44 devstack cinder-volume[82215]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 13:30:44 devstack cinder-volume[82215]: framework.  For more detail see
Apr 09 13:30:44 devstack cinder-volume[82215]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 13:30:44 devstack cinder-volume[82215]:   import eventlet  # noqa
Apr 09 13:30:45 devstack cinder-volume[82215]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 13:30:45 devstack cinder-volume[82215]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 13:30:45 devstack cinder-volume[82215]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO dbcounter [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Registered counter for database cinder
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG dbcounter [-] [82215] Writer thread running {{(pid=82215) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO cinder.rpc [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO cinder.rpc [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO cinder.volume.manager [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Determined volume DB was empty at startup.
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG cinder.volume.manager [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82215) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 13:30:46 devstack cinder-volume[82215]: WARNING stevedore.named [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 13:30:46 devstack cinder-volume[82215]: WARNING castellan.key_manager [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:30:46 devstack cinder-volume[82215]: WARNING cinder.keymgr.conf_key_mgr [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO cinder.volume.manager [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:46 devstack cinder-volume[82215]: INFO oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Starting 1 workers
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Started child 82360 {{(pid=82215) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Full set of CONF: {{(pid=82215) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] ******************************************************************************** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Configuration options gathered from: {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] ================================================================================ {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] allow_availability_zone_fallback = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] allow_compression_on_image_upload = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] allowed_direct_url_schemes     = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] api_rate_limit                 = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] auth_strategy                  = keystone {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_availability_zone      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_host                   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_name                   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_stats_polling_interval = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backup_api_class               = cinder.backup.api.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backup_name_template           = backup-%s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backup_use_same_host           = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backup_use_temp_snapshot       = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] chap_password                  = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] chap_username                  =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_internal_tenant_project_id = 4e933ddc8a324499a9c8bc52dce1d391 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_internal_tenant_user_id = e443f5123ede41faa7d1f4e00229cfd1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cluster                        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] compression_format             = gzip {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] config_dir                     = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] config_source                  = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] control_exchange               = openstack {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] debug                          = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] default_availability_zone      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] default_group_type             = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] default_volume_type            = QuobyteHD {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] disk_geometry                  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82360]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_client_cert             = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_client_cert_key         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_data_namespace          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_ssl_cert_path           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_ssl_cert_verify         = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] driver_use_ssl                 = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] enable_new_services            = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] enable_unsupported_driver      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] enforce_multipath_for_image_xfer = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] filter_function                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_api_insecure            = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_api_ssl_compression     = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_ca_certificates_file    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_certfile                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_keyfile                 = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_num_retries             = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance_request_timeout         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] goodness_function              = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] graceful_shutdown_timeout      = 5 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] group_api_class                = cinder.group.api.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] host                           = devstack {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_compress_on_upload       = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_conversion_address_space_limit = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_conversion_cpu_limit     = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_conversion_disable       = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_upload_use_cinder_backend = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_upload_use_internal_tenant = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_volume_cache_enabled     = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_volume_cache_max_count   = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] image_volume_cache_max_size_gb = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] init_host_max_objects_retrieval = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iscsi_target_flags             =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iscsi_write_cache              = on {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iser_helper                    = tgtadm {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iser_ip_address                = 192.168.122.132 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iser_port                      = 3260 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_color                      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_config_append              = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_dir                        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_file                       = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_options                    = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_rotate_interval            = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_rotate_interval_type       = days {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] log_rotation_type              = none {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] max_age                        = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] max_logfile_count              = 30 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] max_logfile_size_mb            = 200 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] max_over_subscription_ratio    = 20.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] message_reap_interval          = 86400 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] message_ttl                    = 2592000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] migration_create_volume_timeout_secs = 300 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] monkey_patch                   = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] monkey_patch_modules           = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] my_ip                          = 192.168.122.132 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] no_snapshot_gb_quota           = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] num_iser_scan_tries            = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] num_shell_tries                = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] num_volume_device_scan_tries   = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] nvmeof_conn_info_version       = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] nvmet_ns_id                    = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] nvmet_port_id                  = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_max_limit                = 1000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_ext_list          = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_listen_port       = 8776 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_use_ssl           = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] osapi_volume_workers           = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] per_volume_size_limit          = -1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] periodic_fuzzy_delay           = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] periodic_interval              = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] public_endpoint                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] publish_errors                 = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_backup_gigabytes         = 1000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_backups                  = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_gigabytes                = 1000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_groups                   = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_snapshots                = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] quota_volumes                  = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] rate_limit_burst               = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] rate_limit_except_level        = CRITICAL {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] rate_limit_interval            = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] reinit_driver_count            = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] replication_device             = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] report_discard_supported       = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] report_interval                = 120 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] reservation_clean_interval     = 86400 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] reservation_expire             = 86400 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] reserved_image_namespaces      = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] reserved_percentage            = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] rpc_response_timeout           = 120 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] run_external_periodic_tasks    = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] scst_target_driver             = iscsi {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] scst_target_iqn_name           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_down_time              = 720 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] shell_completion               = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] snapshot_name_template         = snapshot-%s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] split_loggers                  = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] state_path                     = /opt/stack/data/cinder {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] storage_availability_zone      = nova {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] storage_protocol               = iSCSI {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] syslog_log_facility            = LOG_USER {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_helper                  = lioadm {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_ip_address              = 192.168.122.132 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_port                    = 3260 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_protocol                = iscsi {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] target_secondary_ip_addresses  = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] trace_flags                    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] transport_url                  = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] until_refresh                  = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_chap_auth                  = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_default_quota_class        = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_journal                    = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_json                       = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_multipath_for_image_xfer   = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_stderr                     = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] use_syslog                     = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] verify_glance_signatures       = enabled {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_api_class               = cinder.volume.api.API {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_backend_name            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_clear                   = zero {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_clear_ionice            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_clear_size              = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_copy_bps_limit          = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_dd_blocksize            = 1M {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_name_template           = volume-%s {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_service_inithost_offload = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volume_usage_audit_period      = month {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] zoning_mode                    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_concurrency.disable_process_locking = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.admin_password = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:46 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.admin_token = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.admin_user  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_protocol = https {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_section = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_type   = password {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_uri    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.auth_version = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.cache       = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.certfile    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.identity_uri = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.include_service_catalog = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.insecure    = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.interface   = public {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.keyfile     = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_password =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcache_username =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.region_name = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.service_type = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.backend                  = dogpile.cache.null {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.backend_argument         = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.backend_expiration_time  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.config_prefix            = cache.oslo {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82360) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.debug_cache_backend      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.enable_retry_client      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.enable_socket_keepalive  = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.enabled                  = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.enforce_fips_mode        = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.expiration_time          = 600 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.hashclient_retry_attempts = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_dead_retry      = 300 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_sasl_enabled    = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.password                 = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.proxies                  = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.redis_db                 = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.redis_server             = localhost:6379 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.retry_attempts           = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.retry_delay              = 0.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.socket_keepalive_count   = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.socket_keepalive_idle    = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.socket_keepalive_interval = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.socket_timeout           = 1.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.tls_allowed_ciphers      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.tls_cafile               = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.tls_certfile             = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.tls_enabled              = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.tls_keyfile              = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cache.username                 = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] coordination.backend_url       = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.asyncio_connection    = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.asyncio_slave_connection = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.backend               = sqlalchemy {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.connection            = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.connection_debug      = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.connection_parameters =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.connection_recycle_time = 3600 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.connection_trace      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.db_inc_retry_interval = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.db_max_retries        = 20 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.db_max_retry_interval = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.db_retry_interval     = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.max_overflow          = 50 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.max_pool_size         = 5 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.max_retries           = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.mysql_wsrep_sync_wait = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.pool_timeout          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.retry_interval        = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.slave_connection      = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.sqlite_synchronous    = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.synchronous_reader    = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] database.use_db_reconnect      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack quobyte-client[82365]: Reading configuration file: /etc/quobyte/client.cfg
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.connection_string     = messaging:// {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.enabled               = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.es_doc_type           = notification {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.es_scroll_size        = 10000 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.es_scroll_time        = 2m {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.filter_error_trace    = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack quobyte-client[82365]: Invalid parameters found, error: missing mount point.
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.hmac_keys             = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.sentinel_service_name = mymaster {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.socket_timeout        = 0.1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.trace_requests        = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler.trace_sqlalchemy      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler_jaeger.process_tags   = {} {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler_jaeger.service_name_prefix = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack quobyte-client[82365]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] profiler_otlp.service_name_prefix = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.enforce_new_defaults = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: WARNING oslo_config.cfg [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.enforce_scope      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.policy_default_rule = default {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack quobyte-client[82365]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack sudo[82369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.group          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.helper_command = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack sudo[82369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] privsep_osbrick.user           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.group         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.helper_command = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] cinder_sys_admin.user          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.auth_section      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.auth_type         = password {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.cafile            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.certfile          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.collect_timing    = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.insecure          = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.keyfile           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.send_service_user_token = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.split_loggers     = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] service_user.timeout           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.auth_section            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.auth_type               = password {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.certfile                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.collect_timing          = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.insecure                = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.keyfile                 = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.region_name             = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.split_loggers           = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] glance.timeout                 = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.backend_availability_zone = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.chap_password = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.chap_username =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.disk_geometry = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_client_cert = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_client_cert_key = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_data_namespace = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.driver_use_ssl = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.extra_capabilities = {} {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.filter_function = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.goodness_function = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iscsi_target_flags =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iscsi_write_cache = on {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iser_port     = 3260 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_host      =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_login     = admin {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_mount_options = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_password  = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_private_key =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_share_path =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.num_shell_tries = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.quobyte_volume_url = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.replication_device = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.report_discard_supported = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.reserved_percentage = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_helper = tgtadm {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_port   = 3260 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_protocol = iscsi {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.trace_flags   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.unique_fqdn_network = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.use_chap_auth = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_backend_name = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_clear  = zero {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_clear_ionice = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_clear_size = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_reports.file_event_handler = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82360) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 13:30:47 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 13:30:47 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_reports.log_dir           = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.backend_availability_zone = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.backend_host         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.chap_password        = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.chap_username        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.disk_geometry        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_client_cert   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_data_namespace = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.extra_capabilities   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.filter_function      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.goodness_function    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iser_helper          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iser_ip_address      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iser_port            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_host             = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_login            = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_mount_options    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_password         = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_private_key      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_share_path       = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.num_shell_tries      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.replication_device   = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.report_discard_supported = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.reserved_percentage  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.scst_target_driver   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.storage_protocol     = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_helper        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_ip_address    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_port          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_prefix        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_protocol      = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.trace_flags          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.use_chap_auth        = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_clear         = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_clear_size    = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] QuobyteHD.volumes_dir          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_notifications.driver = [] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_notifications.retry = -1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] key_manager.fixed_key          = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.barbican_api_version  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.barbican_endpoint     = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.barbican_endpoint_type = public {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.barbican_region_name  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.cafile                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.certfile              = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.collect_timing        = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.insecure              = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.keyfile               = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.number_of_retries     = 60 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.retry_delay           = 1 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.send_service_user_token = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.split_loggers         = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.timeout               = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.verify_ssl            = True {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican.verify_ssl_path       = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.auth_section = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.auth_type = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.cafile   = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.certfile = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.collect_timing = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.insecure = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.keyfile  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.split_loggers = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] barbican_service_user.timeout  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.approle_role_id          = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.approle_secret_id        = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.kv_mountpoint            = secret {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.kv_path                  = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.kv_version               = 2 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.namespace                = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.root_token_id            = **** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.ssl_ca_crt_file          = None {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.timeout                  = 60.0 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.use_ssl                  = False {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 13:30:47 devstack cinder-volume[82215]: DEBUG oslo_service.backend._eventlet.service [None req-fc3113c0-1259-43ac-8e34-8cbda6160341 None None] ******************************************************************************** {{(pid=82215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 13:30:47 devstack sudo[82369]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.735s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:47 devstack cinder-volume[82360]: INFO cinder.volume.driver [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.volume.driver [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7121238708496, 'free_capacity_gb': 1775.7121238708496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82360) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG oslo_db.sqlalchemy.engines [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82360) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writer thread running {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 13:30:47 devstack cinder-volume[82360]: DEBUG cinder.db.sqlalchemy.api [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Building query based on filter {{(pid=82360) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82360) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:48 devstack cinder-volume[82360]: INFO cinder.keymgr.migration [None req-720e9aa3-3ba1-43d1-a34c-e0ff3d7292f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 13:30:48 devstack sudo[82446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:48 devstack sudo[82446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:48 devstack sudo[82446]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:30:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Driver initialization completed successfully.
Apr 09 13:30:48 devstack cinder-volume[82360]: INFO cinder.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Initiating service 3 cleanup
Apr 09 13:30:48 devstack cinder-volume[82360]: INFO cinder.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Service 3 cleanup completed.
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.service [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Creating RPC server for service cinder-volume {{(pid=82360) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.service [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82360) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 13:30:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:30:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:30:48 devstack sudo[82462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:30:48 devstack sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:30:49 devstack sudo[82462]: pam_unix(sudo:session): session closed for user root
Apr 09 13:30:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:30:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d4853b90-ba43-4389-8a9e-f58c3d1c18c4 None None] Driver post RPC initialization completed successfully.
Apr 09 13:30:56 devstack cinder-volume[82215]: DEBUG dbcounter [-] [82215] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82215) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:30:58 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:30:59 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=4 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Flow 'volume_create_manager' (80b48d61-a8ee-4ec0-9c25-9ac1ad26408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b90ce38-c4bd-4a41-aedd-ad127429295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b90ce38-c4bd-4a41-aedd-ad127429295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2016528947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c77d91-fda0-4d40-a6d0-f2f6c6d83eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07c9f4f437f42ac92b1cfe26fdcbc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:51Z,use_quota=True,user_id='545d219fa5bb42858cfbca77a3d20804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b12b479-0f0a-405e-a0ec-a3e1c08b66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b12b479-0f0a-405e-a0ec-a3e1c08b66c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b048bcf-03b5-40c1-ae6a-68e17e4ad6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b048bcf-03b5-40c1-ae6a-68e17e4ad6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c77d91-fda0-4d40-a6d0-f2f6c6d83eea', 'volume_name': 'volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b396d5-72ad-4c55-af38-133decce6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b396d5-72ad-4c55-af38-133decce6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942af639-7673-468c-bf7b-5e0dee04f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:51 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Volume 73c77d91-fda0-4d40-a6d0-f2f6c6d83eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea', 'volume_size': 1}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2016528947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c77d91-fda0-4d40-a6d0-f2f6c6d83eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07c9f4f437f42ac92b1cfe26fdcbc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:51Z,use_quota=True,user_id='545d219fa5bb42858cfbca77a3d20804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Creating volume 73c77d91-fda0-4d40-a6d0-f2f6c6d83eea {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:31:51 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:31:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:31:51 devstack sudo[82962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea 1073741824
Apr 09 13:31:51 devstack sudo[82962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:31:53 devstack sudo[82962]: pam_unix(sudo:session): session closed for user root
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea 1073741824" returned: 0 in 1.336s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Flow 'volume_create_manager' (b6a04f19-0214-4d66-bbb3-c7a4edb67a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7345f152-bfa3-4051-acc4-7e67a8cd6e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7345f152-bfa3-4051-acc4-7e67a8cd6e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1795551574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae37b5b0-a106-47d7-a38a-612c9b22367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e951b373b074ca89e50711e81d2a0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:53Z,use_quota=True,user_id='f7a9c46493e74841986ac92b8de8931a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ae99e-c3c9-4171-a86b-5eb8e7351be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ae99e-c3c9-4171-a86b-5eb8e7351be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc095c80-91d8-42c2-a830-8f4c49e3061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc095c80-91d8-42c2-a830-8f4c49e3061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae37b5b0-a106-47d7-a38a-612c9b22367b', 'volume_name': 'volume-ae37b5b0-a106-47d7-a38a-612c9b22367b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f893294-96c3-4f02-8d04-4c889a195a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f893294-96c3-4f02-8d04-4c889a195a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2158c-db14-4ea4-a13f-bcb23b527724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Volume ae37b5b0-a106-47d7-a38a-612c9b22367b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae37b5b0-a106-47d7-a38a-612c9b22367b', 'volume_size': 1}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:31:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:31:53 devstack sudo[83282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea
Apr 09 13:31:53 devstack sudo[83282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:31:54 devstack sudo[83282]: pam_unix(sudo:session): session closed for user root
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" returned: 0 in 0.948s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] <== create_volume: return (2542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.546s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1795551574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae37b5b0-a106-47d7-a38a-612c9b22367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e951b373b074ca89e50711e81d2a0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:53Z,use_quota=True,user_id='f7a9c46493e74841986ac92b8de8931a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Creating volume ae37b5b0-a106-47d7-a38a-612c9b22367b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:31:54 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:31:54 devstack sudo[83286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b 1073741824
Apr 09 13:31:54 devstack sudo[83286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942af639-7673-468c-bf7b-5e0dee04f36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ab6fa4-734d-40f1-98ed-5267e3ca7866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Volume volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea (73c77d91-fda0-4d40-a6d0-f2f6c6d83eea): created successfully
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ab6fa4-734d-40f1-98ed-5267e3ca7866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Flow 'volume_create_manager' (80b48d61-a8ee-4ec0-9c25-9ac1ad26408e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:31:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-63006732-82f4-45a7-ad03-c70b6963be0b tempest-DeleteServersTestJSON-1630928953 None] Created volume successfully.
Apr 09 13:31:55 devstack sudo[83286]: pam_unix(sudo:session): session closed for user root
Apr 09 13:31:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b 1073741824" returned: 0 in 1.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:31:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:31:55 devstack sudo[83300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b
Apr 09 13:31:55 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:31:57 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b" returned: 0 in 1.235s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] <== create_volume: return (2801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.804s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2158c-db14-4ea4-a13f-bcb23b527724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae37b5b0-a106-47d7-a38a-612c9b22367b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12ac647-daa9-40f1-9c6a-7e58bba3813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:31:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Volume volume-ae37b5b0-a106-47d7-a38a-612c9b22367b (ae37b5b0-a106-47d7-a38a-612c9b22367b): created successfully
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12ac647-daa9-40f1-9c6a-7e58bba3813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:31:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Flow 'volume_create_manager' (b6a04f19-0214-4d66-bbb3-c7a4edb67a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:31:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-31ba8c1a-24b6-4bbb-aa06-c6da6360a968 tempest-VolumesAdminNegativeTest-1561650436 None] Created volume successfully.
Apr 09 13:31:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Acquiring lock "cinder-ae37b5b0-a106-47d7-a38a-612c9b22367b-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:31:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "cinder-ae37b5b0-a106-47d7-a38a-612c9b22367b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:31:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Acquiring lock "cinder-quobyte-ae37b5b0-a106-47d7-a38a-612c9b22367b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:31:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "cinder-quobyte-ae37b5b0-a106-47d7-a38a-612c9b22367b" acquired by "delete_volume" :: waited 0.033s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:31:58 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7uerr02q/privsep.sock']
Apr 09 13:31:58 devstack sudo[83325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7uerr02q/privsep.sock
Apr 09 13:31:58 devstack sudo[83325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 13:31:59 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 13:32:00 devstack cinder-volume[82360]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 09 13:32:01 devstack sudo[83325]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:01 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Spawned new privsep daemon via rootwrap
Apr 09 13:32:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Accepted privsep connection to /tmp/tmp7uerr02q/privsep.sock {{(pid=82360) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 09 13:32:01 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 09 13:32:01 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 09 13:32:01 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 09 13:32:01 devstack cinder-volume[82360]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83333
Apr 09 13:32:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d0d467-e23a-4720-98e7-0c3ece9f9669]: (2,) {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c058c3-983b-4151-b720-257484a1a6ce]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:01 devstack sudo[83337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b
Apr 09 13:32:01 devstack sudo[83337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:02 devstack cinder-volume[82360]: WARNING py.warnings [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 09 13:32:02 devstack cinder-volume[82360]:   .first()
Apr 09 13:32:02 devstack cinder-volume[82360]: 
Apr 09 13:32:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cefe12d-4443-4228-95e9-bac3e615d428]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:03 devstack sudo[83373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea
Apr 09 13:32:03 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:03 devstack sudo[83337]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b" returned: 0 in 2.139s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:04 devstack sudo[83379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b
Apr 09 13:32:04 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:04 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" returned: 0 in 1.879s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.946s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48', 'name': 'volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc576937-e5a5-4965-8d96-c079696f7671', 'enforce_multipath': True} {{(pid=82360) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:05 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:05 devstack sudo[83388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:05 devstack sudo[83388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ae37b5b0-a106-47d7-a38a-612c9b22367b" returned: 0 in 1.362s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "cinder-quobyte-ae37b5b0-a106-47d7-a38a-612c9b22367b" released by "delete_volume" :: held 6.518s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:05 devstack cinder-volume[82360]: WARNING cinder.quota [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:32:05 devstack cinder-volume[82360]: WARNING cinder.quota [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:32:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-c544a170-c402-4014-bd7d-11eac65f65d4 req-69d4d53c-0370-4048-ae47-821eaff1dec2 tempest-DeleteServersTestJSON-1630928953 None] attachment_update completed successfully.
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Created reservations ['2bb2d2f5-cb2b-45a0-8981-cfd07050659f', '12aa234c-7be5-4e5a-b85d-4a9269ce4e57', 'd1448d1f-d29e-478d-8080-59e2f8662a75', 'd5960ad1-7d71-4c7a-a211-ac6dccf84f9f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:06 devstack sudo[83391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:06 devstack sudo[83391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:06 devstack sudo[83388]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.180s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:06 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:07 devstack sudo[83391]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:07 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Deleted volume successfully.
Apr 09 13:32:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-08365c1b-8fb9-4bdb-b5e7-ef2eb62b9e4d tempest-VolumesAdminNegativeTest-1561650436 None] Lock "cinder-ae37b5b0-a106-47d7-a38a-612c9b22367b-delete_volume" released by "delete_volume" :: held 8.855s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Flow 'volume_create_manager' (26a0d340-79be-48a1-b58c-a26dfb4ed419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cabb5c-32a4-473d-a8d0-689a04df81b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cabb5c-32a4-473d-a8d0-689a04df81b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1117554936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6140ce7-711d-4556-b485-a1e6be1cf5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79e13ad21254b78a244d374606cf1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:15Z,use_quota=True,user_id='ef2be376bb934afbb738f7a9f62c1616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081cf3c-540a-4fd1-9f19-269bcc48c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081cf3c-540a-4fd1-9f19-269bcc48c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ee6fa1-a5e9-4e89-8f0b-3f59aaa2cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ee6fa1-a5e9-4e89-8f0b-3f59aaa2cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6140ce7-711d-4556-b485-a1e6be1cf5a6', 'volume_name': 'volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08663099-c1c3-4672-a569-ec149b4831f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08663099-c1c3-4672-a569-ec149b4831f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5d71c1-6c9e-445e-babd-43b345dd4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:15 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Volume c6140ce7-711d-4556-b485-a1e6be1cf5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6', 'volume_size': 1}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1117554936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6140ce7-711d-4556-b485-a1e6be1cf5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79e13ad21254b78a244d374606cf1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:15Z,use_quota=True,user_id='ef2be376bb934afbb738f7a9f62c1616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Creating volume c6140ce7-711d-4556-b485-a1e6be1cf5a6 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:15 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:15 devstack sudo[83914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 1073741824
Apr 09 13:32:15 devstack sudo[83914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:15 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-52240b3b-d244-4af6-8808-3a956e39cc86 req-b970b0d6-452f-453d-998c-c5a0aa5faffe tempest-DeleteServersTestJSON-1630928953 None] Terminate volume connection completed successfully.
Apr 09 13:32:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-52240b3b-d244-4af6-8808-3a956e39cc86 req-b970b0d6-452f-453d-998c-c5a0aa5faffe tempest-DeleteServersTestJSON-1630928953 None] Deleting attachment bc576937-e5a5-4965-8d96-c079696f7671. {{(pid=82360) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 13:32:16 devstack sudo[83914]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 1073741824" returned: 0 in 0.655s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:16 devstack sudo[83923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6
Apr 09 13:32:16 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:16 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6" returned: 0 in 0.629s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5d71c1-6c9e-445e-babd-43b345dd4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f758b9e-4a94-499d-aa8a-85ef3fdd7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:16 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Volume volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 (c6140ce7-711d-4556-b485-a1e6be1cf5a6): created successfully
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f758b9e-4a94-499d-aa8a-85ef3fdd7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Flow 'volume_create_manager' (26a0d340-79be-48a1-b58c-a26dfb4ed419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-851e2b07-ae92-46db-94ca-7d2354c9631f tempest-ServersNegativeTestJSON-1596652879 None] Created volume successfully.
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Flow 'volume_create_manager' (c61ff46a-7b76-456a-bccb-ffdd763a237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0223fd3e-a204-4139-8ee7-a13aac1ad961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0223fd3e-a204-4139-8ee7-a13aac1ad961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-862966751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d89c825-933e-4d73-9e14-fdb8072c5386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79e13ad21254b78a244d374606cf1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:19Z,use_quota=True,user_id='ef2be376bb934afbb738f7a9f62c1616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c383ad56-f132-4531-b44f-54bb3b84b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c383ad56-f132-4531-b44f-54bb3b84b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952dd4cd-7799-4a21-a4dd-ddb250ba435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952dd4cd-7799-4a21-a4dd-ddb250ba435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d89c825-933e-4d73-9e14-fdb8072c5386', 'volume_name': 'volume-1d89c825-933e-4d73-9e14-fdb8072c5386', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7febee20-3943-44b0-a6f0-c4803a97a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7febee20-3943-44b0-a6f0-c4803a97a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a572de86-bf55-4177-8839-25a9d89e36dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:18 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Volume 1d89c825-933e-4d73-9e14-fdb8072c5386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d89c825-933e-4d73-9e14-fdb8072c5386', 'volume_size': 1}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-862966751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d89c825-933e-4d73-9e14-fdb8072c5386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79e13ad21254b78a244d374606cf1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:19Z,use_quota=True,user_id='ef2be376bb934afbb738f7a9f62c1616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Creating volume 1d89c825-933e-4d73-9e14-fdb8072c5386 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:18 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:18 devstack sudo[83944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 1073741824
Apr 09 13:32:18 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:19 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 1073741824" returned: 0 in 0.670s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:19 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386
Apr 09 13:32:19 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "cinder-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "cinder-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "cinder-quobyte-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "cinder-quobyte-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a6fc02-96c2-4e4b-8c81-c5d39fcb8731]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:20 devstack sudo[83951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea
Apr 09 13:32:20 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:20 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386" returned: 0 in 0.729s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a572de86-bf55-4177-8839-25a9d89e36dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d89c825-933e-4d73-9e14-fdb8072c5386', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c11995a-b3d0-4ed7-8684-028e204de7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Volume volume-1d89c825-933e-4d73-9e14-fdb8072c5386 (1d89c825-933e-4d73-9e14-fdb8072c5386): created successfully
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c11995a-b3d0-4ed7-8684-028e204de7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Flow 'volume_create_manager' (c61ff46a-7b76-456a-bccb-ffdd763a237f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:20 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1d463fc1-8904-4c3f-9448-83690e7e9782 tempest-ServersNegativeTestJSON-1596652879 None] Created volume successfully.
Apr 09 13:32:20 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" returned: 0 in 0.665s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:20 devstack sudo[83958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea
Apr 09 13:32:20 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:21 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" returned: 0 in 0.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "cinder-quobyte-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea" released by "delete_volume" :: held 1.284s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Created reservations ['d990fe50-a3dc-45d8-a6a0-5b4135119eb4', '76398eeb-2235-4acc-a795-0bba237c5116', '260e1576-c010-4e7b-902d-efa947db23d3', '6706b6c0-72b7-4303-8a1d-94a05b79b9ee'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "cinder-1d89c825-933e-4d73-9e14-fdb8072c5386-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-1d89c825-933e-4d73-9e14-fdb8072c5386-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:21 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:21 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "cinder-quobyte-1d89c825-933e-4d73-9e14-fdb8072c5386" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-quobyte-1d89c825-933e-4d73-9e14-fdb8072c5386" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b7b3f6-aeee-4dab-b29e-f881c85cd7a1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:21 devstack sudo[83966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386
Apr 09 13:32:21 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:22 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386" returned: 0 in 0.613s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:22 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:22 devstack sudo[83973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386
Apr 09 13:32:22 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.779s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Deleted volume successfully.
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a9a90fe-8be8-433b-8310-926100ab0454 tempest-DeleteServersTestJSON-1630928953 None] Lock "cinder-73c77d91-fda0-4d40-a6d0-f2f6c6d83eea-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:22 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d89c825-933e-4d73-9e14-fdb8072c5386" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-quobyte-1d89c825-933e-4d73-9e14-fdb8072c5386" released by "delete_volume" :: held 1.145s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Created reservations ['ce49c7ee-f159-4d3c-b435-80d7a400abdb', '613ccc3c-5b33-4147-9f68-0bba97098691', 'c9b2a1c6-abc9-4eb2-b69e-46b85f2dcc05', '090a86e8-b46a-4516-9207-86241e41ed56'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:22 devstack sudo[84000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:22 devstack sudo[84000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "cinder-c6140ce7-711d-4556-b485-a1e6be1cf5a6-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-c6140ce7-711d-4556-b485-a1e6be1cf5a6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "cinder-quobyte-c6140ce7-711d-4556-b485-a1e6be1cf5a6" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-quobyte-c6140ce7-711d-4556-b485-a1e6be1cf5a6" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[392e985e-fac6-4fc8-b028-8e8f00a90448]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:24 devstack sudo[84000]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.324s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:24 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Deleted volume successfully.
Apr 09 13:32:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dabc7459-ef48-40d4-bc91-dbed322ab364 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-1d89c825-933e-4d73-9e14-fdb8072c5386-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:24 devstack sudo[84008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6
Apr 09 13:32:24 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:24 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6" returned: 0 in 0.968s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:24 devstack sudo[84017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6
Apr 09 13:32:24 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:25 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6140ce7-711d-4556-b485-a1e6be1cf5a6" returned: 0 in 0.759s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-quobyte-c6140ce7-711d-4556-b485-a1e6be1cf5a6" released by "delete_volume" :: held 1.806s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Created reservations ['a8bbcc78-2eba-4c76-b760-3a3593c5b9ab', 'c7c209c3-e725-45fd-b854-fb3c693b4ce7', '83fa764a-9d02-4f53-911f-3960fc36ebb1', '976596b8-76d6-420a-b846-c77e48cd6f5f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:25 devstack sudo[84026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:25 devstack sudo[84026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:26 devstack sudo[84026]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:26 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Deleted volume successfully.
Apr 09 13:32:26 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8fabaaf0-458e-41c7-a9f4-40018f65d6f5 tempest-ServersNegativeTestJSON-1596652879 None] Lock "cinder-c6140ce7-711d-4556-b485-a1e6be1cf5a6-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:35 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=37,cinder:SELECT=33,cinder:DELETE=4,cinder:INSERT=9 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:32:36 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=36,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=4 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Flow 'volume_create_manager' (fb88f017-02dd-4178-bae5-c60324ff1657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8d644d-7736-4533-bc4c-dee62029245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8d644d-7736-4533-bc4c-dee62029245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1353283320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab204fa-6288-4ddc-9bb4-31fd67526474,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47abbe062db14c6a9000f71263d027f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:41Z,use_quota=True,user_id='5f9869e89c4649cfb2ae72a73806bccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3128933-057a-4065-ac2a-35d78c04641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3128933-057a-4065-ac2a-35d78c04641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79d285-6046-45cc-80e0-d1ff5ba02b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79d285-6046-45cc-80e0-d1ff5ba02b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab204fa-6288-4ddc-9bb4-31fd67526474', 'volume_name': 'volume-4ab204fa-6288-4ddc-9bb4-31fd67526474', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2987906-717b-41ef-82a3-0fba5293a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2987906-717b-41ef-82a3-0fba5293a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10661ba2-3137-4261-92b6-ade7dd60e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:41 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Volume 4ab204fa-6288-4ddc-9bb4-31fd67526474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab204fa-6288-4ddc-9bb4-31fd67526474', 'volume_size': 1}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1353283320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab204fa-6288-4ddc-9bb4-31fd67526474,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47abbe062db14c6a9000f71263d027f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:41Z,use_quota=True,user_id='5f9869e89c4649cfb2ae72a73806bccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Creating volume 4ab204fa-6288-4ddc-9bb4-31fd67526474 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:41 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:41 devstack sudo[84139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 1073741824
Apr 09 13:32:41 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:42 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 1073741824" returned: 0 in 0.745s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:42 devstack sudo[84144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474
Apr 09 13:32:42 devstack sudo[84144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:42 devstack sudo[84144]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474" returned: 0 in 0.568s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10661ba2-3137-4261-92b6-ade7dd60e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab204fa-6288-4ddc-9bb4-31fd67526474', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3448a6-4618-40de-bdbf-2a8e0ee3b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:42 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Volume volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 (4ab204fa-6288-4ddc-9bb4-31fd67526474): created successfully
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3448a6-4618-40de-bdbf-2a8e0ee3b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Flow 'volume_create_manager' (fb88f017-02dd-4178-bae5-c60324ff1657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-f88a67a2-7682-4f2c-96fe-8549904b17e3 req-b06b4c15-adda-43a6-b511-4a47e68e4969 tempest-VolumesGetTestJSON-1520914250 None] Created volume successfully.
Apr 09 13:32:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Acquiring lock "cinder-4ab204fa-6288-4ddc-9bb4-31fd67526474-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "cinder-4ab204fa-6288-4ddc-9bb4-31fd67526474-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Acquiring lock "cinder-quobyte-4ab204fa-6288-4ddc-9bb4-31fd67526474" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "cinder-quobyte-4ab204fa-6288-4ddc-9bb4-31fd67526474" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56523e0-d0f3-4389-83e9-d1f5d9a49c2b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:44 devstack sudo[84153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474
Apr 09 13:32:44 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Flow 'volume_create_manager' (920544b3-ea09-4fac-b013-7e6c96ab2499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d46f3c-043f-423c-9575-fbd6e195fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d46f3c-043f-423c-9575-fbd6e195fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:45Z,deleted=False,deleted_at=None,display_description='',display_name='0e71f2d5-d7fa-4d74-abde-cd3c85a8ab1a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16740eb-201b-49a6-b6d0-2133909d123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a779ffa9a1904092ab26a44213297ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:45Z,use_quota=True,user_id='df053e50c8e84f47a2d75de65fedcc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516354fd-c14e-4d4c-9ae1-9d63209b5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516354fd-c14e-4d4c-9ae1-9d63209b5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece5197f-a115-4a5e-8eb6-bb55c4b17e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:45 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece5197f-a115-4a5e-8eb6-bb55c4b17e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c16740eb-201b-49a6-b6d0-2133909d123d', 'volume_name': 'volume-c16740eb-201b-49a6-b6d0-2133909d123d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d907094-f63a-474d-8c79-05afb0649cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d907094-f63a-474d-8c79-05afb0649cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fec047-a845-4289-880f-1716d7672f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:45 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume c16740eb-201b-49a6-b6d0-2133909d123d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c16740eb-201b-49a6-b6d0-2133909d123d', 'volume_size': 1}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:45Z,deleted=False,deleted_at=None,display_description='',display_name='0e71f2d5-d7fa-4d74-abde-cd3c85a8ab1a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16740eb-201b-49a6-b6d0-2133909d123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a779ffa9a1904092ab26a44213297ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:45Z,use_quota=True,user_id='df053e50c8e84f47a2d75de65fedcc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Creating volume c16740eb-201b-49a6-b6d0-2133909d123d {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:45 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474" returned: 0 in 1.369s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:45 devstack sudo[84166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d 1073741824
Apr 09 13:32:45 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:45 devstack sudo[84167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474
Apr 09 13:32:45 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:46 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d 1073741824" returned: 0 in 0.757s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:46 devstack sudo[84181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d
Apr 09 13:32:46 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:46 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4ab204fa-6288-4ddc-9bb4-31fd67526474" returned: 0 in 0.891s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "cinder-quobyte-4ab204fa-6288-4ddc-9bb4-31fd67526474" released by "delete_volume" :: held 2.299s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.quota [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Created reservations ['a0cdde38-7b7e-4e29-8f9f-a7fb55594d9e', '07ed9476-65f6-4376-9d6a-a3bbbd26dc44', '97c9d4f5-7036-43ec-94d9-1967963987d3', 'e563bdf6-0f5a-4030-9312-924ef22bf8a5'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:46 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:32:46 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:46 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d" returned: 0 in 0.589s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fec047-a845-4289-880f-1716d7672f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c16740eb-201b-49a6-b6d0-2133909d123d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c40fef-f5f0-4df0-823d-3cd904ecf32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:46 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume volume-c16740eb-201b-49a6-b6d0-2133909d123d (c16740eb-201b-49a6-b6d0-2133909d123d): created successfully
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c40fef-f5f0-4df0-823d-3cd904ecf32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Flow 'volume_create_manager' (920544b3-ea09-4fac-b013-7e6c96ab2499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-39ab2c82-2676-4998-89db-0c56ec1e16c7 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Created volume successfully.
Apr 09 13:32:47 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:47 devstack cinder-volume[82360]: DEBUG cinder.manager [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:32:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Deleted volume successfully.
Apr 09 13:32:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-2019ab5a-edcf-42b2-9fab-475a786c50d7 req-800d731b-0137-4657-b7bf-34dde13ed9a3 tempest-VolumesGetTestJSON-1520914250 None] Lock "cinder-4ab204fa-6288-4ddc-9bb4-31fd67526474-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:32:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:48 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8105d1a-8557-426a-a990-f0b14627ca79]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:49 devstack sudo[84234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d
Apr 09 13:32:49 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:49 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d" returned: 0 in 1.038s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48', 'name': 'volume-c16740eb-201b-49a6-b6d0-2133909d123d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2c9dc3e-a983-49c9-ad00-b02a4a448ca1', 'enforce_multipath': True} {{(pid=82360) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 13:32:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-b9b9897a-2761-44c4-b844-d02983ad844c req-6e7701ba-c599-4095-8384-84f295f3626e tempest-ServerBootFromVolumeStableRescueTest-105565284 None] attachment_update completed successfully.
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (dce60004-e56f-4960-8f28-2aacfad6e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672d9791-d453-4fe2-81e9-2abada1e78b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672d9791-d453-4fe2-81e9-2abada1e78b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1919916275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2a0bd-a643-4716-972c-3dda8798b905,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:51Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117d2301-d5ca-46c1-99d0-7a498ae0569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117d2301-d5ca-46c1-99d0-7a498ae0569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff0347-456f-440d-87e2-2ed0fec25183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff0347-456f-440d-87e2-2ed0fec25183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd2a0bd-a643-4716-972c-3dda8798b905', 'volume_name': 'volume-8bd2a0bd-a643-4716-972c-3dda8798b905', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1372eb0-7b8e-49f4-a7d1-e60822640fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1372eb0-7b8e-49f4-a7d1-e60822640fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0353b1f7-592f-496a-803e-ff93b79e5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:50 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Volume 8bd2a0bd-a643-4716-972c-3dda8798b905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd2a0bd-a643-4716-972c-3dda8798b905', 'volume_size': 1}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1919916275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2a0bd-a643-4716-972c-3dda8798b905,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:51Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Creating volume 8bd2a0bd-a643-4716-972c-3dda8798b905 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:50 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:50 devstack sudo[84256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 1073741824
Apr 09 13:32:50 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:51 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 1073741824" returned: 0 in 0.665s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:51 devstack sudo[84262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905
Apr 09 13:32:51 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:52 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905" returned: 0 in 0.827s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0353b1f7-592f-496a-803e-ff93b79e5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd2a0bd-a643-4716-972c-3dda8798b905', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854665bd-ec59-405c-b981-4c1e7ec32429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:52 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Volume volume-8bd2a0bd-a643-4716-972c-3dda8798b905 (8bd2a0bd-a643-4716-972c-3dda8798b905): created successfully
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854665bd-ec59-405c-b981-4c1e7ec32429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (dce60004-e56f-4960-8f28-2aacfad6e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1765bc9d-5c50-493b-826a-f416b1337a81 tempest-VolumesTestJSON-1435993710 None] Created volume successfully.
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (ec373487-b8f1-48a3-90d4-00f8cbcab62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78412ef9-b0d6-41db-bb05-d024bfa59394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78412ef9-b0d6-41db-bb05-d024bfa59394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1567997822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b3cbc-63fd-4736-bbcf-33e1fbe695cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:53Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffc8312-9e6a-4ef4-a9c8-f6f0e86fca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffc8312-9e6a-4ef4-a9c8-f6f0e86fca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb04608-6b95-4a98-8cc1-abcca60fa088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb04608-6b95-4a98-8cc1-abcca60fa088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97b3cbc-63fd-4736-bbcf-33e1fbe695cd', 'volume_name': 'volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886c50e-05a1-4623-b517-5ded320df07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886c50e-05a1-4623-b517-5ded320df07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f201399-24d7-4023-a244-d04cb64ec76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Volume d97b3cbc-63fd-4736-bbcf-33e1fbe695cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd', 'volume_size': 1}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1567997822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b3cbc-63fd-4736-bbcf-33e1fbe695cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:53Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Creating volume d97b3cbc-63fd-4736-bbcf-33e1fbe695cd {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:53 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:53 devstack sudo[84358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd 1073741824
Apr 09 13:32:53 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:54 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd 1073741824" returned: 0 in 0.698s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:54 devstack sudo[84369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd
Apr 09 13:32:54 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:54 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f201399-24d7-4023-a244-d04cb64ec76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d9b2d0-5a98-4841-9c74-d585cd50ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Volume volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd (d97b3cbc-63fd-4736-bbcf-33e1fbe695cd): created successfully
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d9b2d0-5a98-4841-9c74-d585cd50ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (ec373487-b8f1-48a3-90d4-00f8cbcab62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-bb1710f2-c5cf-4e14-ac9a-f5d4f2b1eedf tempest-VolumesTestJSON-1435993710 None] Created volume successfully.
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (30e705ba-f492-4e75-84aa-ffa947b7a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05ab4a9-43b2-47c9-b471-4352b5b3f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05ab4a9-43b2-47c9-b471-4352b5b3f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-718954077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:56Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff653e0-9d10-4a5b-919d-8dc64ac41524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff653e0-9d10-4a5b-919d-8dc64ac41524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa77fee9-4fec-4d52-b335-484f47539f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa77fee9-4fec-4d52-b335-484f47539f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b', 'volume_name': 'volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010371ce-0baa-4698-a9da-dfadb21500d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010371ce-0baa-4698-a9da-dfadb21500d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc91d1e5-5f91-4cc4-abe7-b8d3192e4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:56 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Volume 831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b', 'volume_size': 1}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-718954077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c1453fdcfc241ce82db60afaaeb547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:56Z,use_quota=True,user_id='4b0906a18fc74822ab0ce0e0c56e8fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Creating volume 831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:56 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:56 devstack sudo[84746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b 1073741824
Apr 09 13:32:56 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:57 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b 1073741824" returned: 0 in 0.675s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:57 devstack sudo[84755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b
Apr 09 13:32:57 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Flow 'volume_create_manager' (2a917a35-ad65-4842-bc3f-1926f09e8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812c75f5-dd1b-420e-8ea4-5969ec4d0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812c75f5-dd1b-420e-8ea4-5969ec4d0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-380121003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc6b86a-83ca-4032-982d-ca00b04e40d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546b6d3378464d309e71af5145e1d1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:57Z,use_quota=True,user_id='7ed2db8ec2f6440096a8cbd300ca72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ab9c06-e458-41b3-8f01-c520887c6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ab9c06-e458-41b3-8f01-c520887c6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99122ca5-4231-42e4-bc98-71e5e0931f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99122ca5-4231-42e4-bc98-71e5e0931f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc6b86a-83ca-4032-982d-ca00b04e40d3', 'volume_name': 'volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859b60a9-200c-4afa-b744-c7e12472f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859b60a9-200c-4afa-b744-c7e12472f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae7b93b-1e64-45a7-9b92-81cb3ff820f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume 4fc6b86a-83ca-4032-982d-ca00b04e40d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3', 'volume_size': 1}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:57 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-380121003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc6b86a-83ca-4032-982d-ca00b04e40d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546b6d3378464d309e71af5145e1d1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:57Z,use_quota=True,user_id='7ed2db8ec2f6440096a8cbd300ca72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Creating volume 4fc6b86a-83ca-4032-982d-ca00b04e40d3 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:32:57 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc91d1e5-5f91-4cc4-abe7-b8d3192e4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf36ef8-479a-432a-8d9a-e94707c8dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:57 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 1073741824
Apr 09 13:32:57 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Volume volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b (831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b): created successfully
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf36ef8-479a-432a-8d9a-e94707c8dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Flow 'volume_create_manager' (30e705ba-f492-4e75-84aa-ffa947b7a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3b8fc6de-391f-465d-a24d-138cc036d332 tempest-VolumesTestJSON-1435993710 None] Created volume successfully.
Apr 09 13:32:58 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 1073741824" returned: 0 in 0.949s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:58 devstack sudo[84789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3
Apr 09 13:32:58 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:59 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3" returned: 0 in 0.758s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae7b93b-1e64-45a7-9b92-81cb3ff820f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bae363-abfb-4f9b-82ed-09e688bbc2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:32:59 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 (4fc6b86a-83ca-4032-982d-ca00b04e40d3): created successfully
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bae363-abfb-4f9b-82ed-09e688bbc2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Flow 'volume_create_manager' (2a917a35-ad65-4842-bc3f-1926f09e8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:32:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2556efe7-e575-493e-af79-c35034bad145 tempest-VolumeQuotasAdminTestJSON-2072122944 None] Created volume successfully.
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "cinder-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-quobyte-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" acquired by "delete_volume" :: waited 0.017s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda81b93-1b88-41de-8e2c-1478ba300578]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "cinder-4fc6b86a-83ca-4032-982d-ca00b04e40d3-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "cinder-4fc6b86a-83ca-4032-982d-ca00b04e40d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "cinder-quobyte-4fc6b86a-83ca-4032-982d-ca00b04e40d3" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "cinder-quobyte-4fc6b86a-83ca-4032-982d-ca00b04e40d3" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:32:59 devstack sudo[84794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b
Apr 09 13:32:59 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd11352-6796-4fc7-ba50-47caa5c44a56]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:32:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:32:59 devstack sudo[84798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3
Apr 09 13:32:59 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:00 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" returned: 0 in 0.668s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:00 devstack sudo[84804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b
Apr 09 13:33:00 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:00 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3" returned: 0 in 0.640s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:00 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3
Apr 09 13:33:00 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:00 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b" released by "delete_volume" :: held 1.195s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Created reservations ['6e94768f-4b77-42ad-ad81-1276b509b9ce', '98aa069f-1f5a-4de7-b91e-e46eef5e518e', 'bcc05305-1b45-45e9-b04b-66879b123bca', 'd5ea25ed-1c45-4719-a459-0aa82786c265'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:01 devstack sudo[84811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:01 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:01 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-4fc6b86a-83ca-4032-982d-ca00b04e40d3" returned: 0 in 0.909s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "cinder-quobyte-4fc6b86a-83ca-4032-982d-ca00b04e40d3" released by "delete_volume" :: held 1.626s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Created reservations ['bf7a2be4-8d33-4077-9d95-b32f05498256', '74350403-07d7-4a26-a71e-1219ff018707', '73046a03-0e6c-4453-94fe-22ab4ea6ab5f', 'b065b1f0-c71e-46d8-8c15-22a0f8486fb6'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:01 devstack sudo[84814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:01 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-quobyte-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:01 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.839s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Deleted volume successfully.
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4e3bd8-8e7d-45bf-9927-d7d4c6bae487]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3812773b-f05e-44b0-9a44-a7df96af4f7f tempest-VolumesTestJSON-1435993710 None] Lock "cinder-831fe5a4-f6c5-417a-80e3-3ec8fdfbfa1b-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:02 devstack sudo[84817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd
Apr 09 13:33:02 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:02 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.020s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Deleted volume successfully.
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8276404d-07c7-43c9-a8bc-338614bf3bbe tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "cinder-4fc6b86a-83ca-4032-982d-ca00b04e40d3-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Flow 'volume_create_manager' (71a93ea6-7b94-4fba-88da-bd3ef7cffd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a0860-8604-4ca9-810b-07e113392b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a0860-8604-4ca9-810b-07e113392b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-508766306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e233216e-4e8e-4834-9880-b516ce961cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546b6d3378464d309e71af5145e1d1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:03Z,use_quota=True,user_id='7ed2db8ec2f6440096a8cbd300ca72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da913fe-aa80-468a-bf61-36915a58f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da913fe-aa80-468a-bf61-36915a58f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c166b09-900a-4de6-9f56-df2ddb02eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c166b09-900a-4de6-9f56-df2ddb02eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e233216e-4e8e-4834-9880-b516ce961cfd', 'volume_name': 'volume-e233216e-4e8e-4834-9880-b516ce961cfd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c77bd5-b269-4c1a-83d4-668e7ef05bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c77bd5-b269-4c1a-83d4-668e7ef05bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef20d7c8-fd9b-457c-9c65-bc7d5a08d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:02 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume e233216e-4e8e-4834-9880-b516ce961cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e233216e-4e8e-4834-9880-b516ce961cfd', 'volume_size': 1}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-508766306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e233216e-4e8e-4834-9880-b516ce961cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546b6d3378464d309e71af5145e1d1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:03Z,use_quota=True,user_id='7ed2db8ec2f6440096a8cbd300ca72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Creating volume e233216e-4e8e-4834-9880-b516ce961cfd {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:02 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:02 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd 1073741824
Apr 09 13:33:02 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:02 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" returned: 0 in 0.965s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:02 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd
Apr 09 13:33:02 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:03 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" returned: 0 in 0.921s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd" released by "delete_volume" :: held 1.958s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:03 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Created reservations ['70494fc9-ff26-465c-bf3b-50e1f4bed356', 'aaa769e5-88b4-4ddb-bc62-3625d9a37589', '65ecd0b2-b4cd-4f8a-b537-74e99c2735f9', '3e67a11b-5e0d-421a-9a52-c272347e9d40'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:03 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd 1073741824" returned: 0 in 1.242s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:04 devstack sudo[84858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd
Apr 09 13:33:04 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:04 devstack sudo[84859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:04 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:04 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.612s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:04 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Deleted volume successfully.
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b58841a1-cd56-4f50-bddc-974f83de82a6 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-d97b3cbc-63fd-4736-bbcf-33e1fbe695cd-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:04 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd" returned: 0 in 0.820s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef20d7c8-fd9b-457c-9c65-bc7d5a08d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e233216e-4e8e-4834-9880-b516ce961cfd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e47d12-12db-40a5-ab02-7c9604215654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:04 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Volume volume-e233216e-4e8e-4834-9880-b516ce961cfd (e233216e-4e8e-4834-9880-b516ce961cfd): created successfully
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e47d12-12db-40a5-ab02-7c9604215654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Flow 'volume_create_manager' (71a93ea6-7b94-4fba-88da-bd3ef7cffd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-bae551a1-654d-44f1-ab47-8450d8c0787d tempest-VolumeQuotasAdminTestJSON-2072122944 None] Created volume successfully.
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-8bd2a0bd-a643-4716-972c-3dda8798b905-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:05 devstack sudo[84867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:05 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-8bd2a0bd-a643-4716-972c-3dda8798b905-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "cinder-quobyte-8bd2a0bd-a643-4716-972c-3dda8798b905" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-8bd2a0bd-a643-4716-972c-3dda8798b905" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[808c15fc-93b0-4d37-afa5-5fc43fe19c0a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:05 devstack sudo[84869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905
Apr 09 13:33:05 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:05 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.824s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:06 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905" returned: 0 in 0.787s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:06 devstack sudo[84894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905
Apr 09 13:33:06 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:06 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8bd2a0bd-a643-4716-972c-3dda8798b905" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-quobyte-8bd2a0bd-a643-4716-972c-3dda8798b905" released by "delete_volume" :: held 1.403s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d73365ea-94df-40ac-b8ff-c7031573368c tempest-VolumeQuotasAdminTestJSON-1275482838 None] Transfer volume completed successfully.
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Created reservations ['cb4865ff-e96b-4c2b-bbf6-cb1a109edc23', '57ba506c-2515-47a1-980d-2fcca3abd16d', '6afee2b9-643e-4405-8187-abea8c2c329a', 'bd8e26b4-ad15-43d1-83f9-b18a42fec838'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:06 devstack sudo[84927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:06 devstack sudo[84927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:07 devstack sudo[84927]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Deleted volume successfully.
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b76a24fe-fffb-4107-bc32-bf2091ef81a5 tempest-VolumesTestJSON-1435993710 None] Lock "cinder-8bd2a0bd-a643-4716-972c-3dda8798b905-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Acquiring lock "cinder-e233216e-4e8e-4834-9880-b516ce961cfd-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "cinder-e233216e-4e8e-4834-9880-b516ce961cfd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Acquiring lock "cinder-quobyte-e233216e-4e8e-4834-9880-b516ce961cfd" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "cinder-quobyte-e233216e-4e8e-4834-9880-b516ce961cfd" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c3c62-e6ad-4fbd-ad59-af5bb1604e37]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:07 devstack sudo[84936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd
Apr 09 13:33:07 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:08 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd" returned: 0 in 0.642s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:08 devstack sudo[84943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd
Apr 09 13:33:08 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:08 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e233216e-4e8e-4834-9880-b516ce961cfd" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "cinder-quobyte-e233216e-4e8e-4834-9880-b516ce961cfd" released by "delete_volume" :: held 1.161s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Created reservations ['ca911c3b-036c-458f-80a1-b3d7ba26fa25', '739e928d-7736-4b0e-a9a5-92ff867b2c80', '3e56c9ac-60f4-47d3-a49b-2da7adfa2273', '17046440-2110-4053-88c9-d7bb28ef7e68'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:08 devstack sudo[84946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:08 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:09 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.572s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Deleted volume successfully.
Apr 09 13:33:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0c359b75-f0b7-4e31-b288-37cd36144ca9 tempest-VolumeQuotasAdminTestJSON-986101219 None] Lock "cinder-e233216e-4e8e-4834-9880-b516ce961cfd-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d4e5e891-f5fe-4655-9075-38557c57e6e6 tempest-BackendsCapabilitiesAdminTestsJSON-1631174586 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7121238708496, 'free_capacity_gb': 1775.7121238708496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82360) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 13:33:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3ee4f0ae-e22e-4da6-a2c8-dc2b67b3bbc7 tempest-BackendsCapabilitiesAdminTestsJSON-1631174586 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7121238708496, 'free_capacity_gb': 1775.7121238708496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82360) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Flow 'volume_create_manager' (7afb7aa4-0756-4480-9f37-5af5de9ba195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12589f2e-5758-4f77-9f5c-7d81b834fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12589f2e-5758-4f77-9f5c-7d81b834fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-718190619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93609edd873b41f283019f5e79970321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:15Z,use_quota=True,user_id='d71a24a392a947689056e79d73a2a12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb101a9a-6049-4575-a853-b14a5846dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb101a9a-6049-4575-a853-b14a5846dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be291d4d-8054-42cf-863b-32b06050e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be291d4d-8054-42cf-863b-32b06050e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec', 'volume_name': 'volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f867d-57e6-4f8b-a7f9-8d11e2175b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f867d-57e6-4f8b-a7f9-8d11e2175b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3399f50-55c6-4832-b7a6-7338d85737e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:15 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Volume a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec', 'volume_size': 1}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-718190619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93609edd873b41f283019f5e79970321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:15Z,use_quota=True,user_id='d71a24a392a947689056e79d73a2a12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Creating volume a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:15 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:15 devstack sudo[85042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec 1073741824
Apr 09 13:33:15 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:16 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec 1073741824" returned: 0 in 1.497s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:16 devstack sudo[85076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec
Apr 09 13:33:16 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:18 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" returned: 0 in 1.262s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] <== create_volume: return (2812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.816s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3399f50-55c6-4832-b7a6-7338d85737e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51ad1a8-acaf-443b-8551-287225538689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:18 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Volume volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec (a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec): created successfully
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51ad1a8-acaf-443b-8551-287225538689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Flow 'volume_create_manager' (7afb7aa4-0756-4480-9f37-5af5de9ba195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:18 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5188083f-7b22-4f18-8fb1-45ab41bacd8e tempest-ServerRescueNegativeTestJSON-839467809 None] Created volume successfully.
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Flow 'volume_create_manager' (5a6e7296-5a71-476e-94b2-242564baeeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502331a1-2e21-4aca-adea-2e1419420b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502331a1-2e21-4aca-adea-2e1419420b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-842040977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e39f42-bcee-4c13-b35d-3a86e06fd1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fc7fcad9cc47a998d3338217806cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:20Z,use_quota=True,user_id='db05ab625a2143e6b76ae285620f705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2734445e-fb96-4745-ade8-b516373c2320),volume_type_id=2734445e-fb96-4745-ade8-b516373c2320)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36341e9-39fa-4178-b787-47f812677258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36341e9-39fa-4178-b787-47f812677258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c46784-fb0b-41e6-b897-8f5e47204dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c46784-fb0b-41e6-b897-8f5e47204dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e39f42-bcee-4c13-b35d-3a86e06fd1ba', 'volume_name': 'volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff01a5e-01ae-4780-ba96-ace98e4bbfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff01a5e-01ae-4780-ba96-ace98e4bbfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c8fdce-d370-4343-82c6-6e1fd785827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Volume 54e39f42-bcee-4c13-b35d-3a86e06fd1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba', 'volume_size': 1}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-842040977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e39f42-bcee-4c13-b35d-3a86e06fd1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fc7fcad9cc47a998d3338217806cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:20Z,use_quota=True,user_id='db05ab625a2143e6b76ae285620f705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2734445e-fb96-4745-ade8-b516373c2320),volume_type_id=2734445e-fb96-4745-ade8-b516373c2320)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Creating volume 54e39f42-bcee-4c13-b35d-3a86e06fd1ba {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:20 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:20 devstack sudo[85107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba 1073741824
Apr 09 13:33:20 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Flow 'volume_create_manager' (11794b07-d88f-46d9-ad14-72988be96820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc521a03-e3c9-488d-b22f-08ab545b7bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc521a03-e3c9-488d-b22f-08ab545b7bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1147356772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095ae32f-9df0-4170-b1ab-acffffeb81d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67e66541df54bb882af33cbb25181cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='02d2ec74063b48d5a47bedb459462638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d449822-37f7-4d81-a57d-db29827dba94),volume_type_id=1d449822-37f7-4d81-a57d-db29827dba94)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c5f9d-eeba-44cd-a654-c9f5a463a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c5f9d-eeba-44cd-a654-c9f5a463a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad613d8-5d2f-453b-bf15-1e86425e6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad613d8-5d2f-453b-bf15-1e86425e6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095ae32f-9df0-4170-b1ab-acffffeb81d2', 'volume_name': 'volume-095ae32f-9df0-4170-b1ab-acffffeb81d2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce57a41-6694-436e-a543-e97d3387b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce57a41-6694-436e-a543-e97d3387b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf65989-b998-48ae-a55f-b62350795427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Volume 095ae32f-9df0-4170-b1ab-acffffeb81d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095ae32f-9df0-4170-b1ab-acffffeb81d2', 'volume_size': 1}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:21 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba 1073741824" returned: 0 in 1.048s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:21 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba
Apr 09 13:33:21 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:21 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" returned: 0 in 0.511s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1147356772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095ae32f-9df0-4170-b1ab-acffffeb81d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67e66541df54bb882af33cbb25181cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='02d2ec74063b48d5a47bedb459462638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d449822-37f7-4d81-a57d-db29827dba94),volume_type_id=1d449822-37f7-4d81-a57d-db29827dba94)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Creating volume 095ae32f-9df0-4170-b1ab-acffffeb81d2 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:21 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c8fdce-d370-4343-82c6-6e1fd785827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431ce215-cd80-4bca-af1a-203fa4129d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:21 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 1073741824
Apr 09 13:33:21 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Volume volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba (54e39f42-bcee-4c13-b35d-3a86e06fd1ba): created successfully
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431ce215-cd80-4bca-af1a-203fa4129d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Flow 'volume_create_manager' (5a6e7296-5a71-476e-94b2-242564baeeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ea497cb3-be31-4b92-89eb-54553b5cd6dd tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Created volume successfully.
Apr 09 13:33:22 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 1073741824" returned: 0 in 0.606s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:22 devstack sudo[85127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2
Apr 09 13:33:22 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:22 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:22 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:23 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2" returned: 0 in 0.623s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf65989-b998-48ae-a55f-b62350795427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095ae32f-9df0-4170-b1ab-acffffeb81d2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afaa843-b161-4179-b42d-494d0ab8020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:23 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Volume volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 (095ae32f-9df0-4170-b1ab-acffffeb81d2): created successfully
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afaa843-b161-4179-b42d-494d0ab8020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Flow 'volume_create_manager' (11794b07-d88f-46d9-ad14-72988be96820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-065fa066-0acd-4e5c-88d7-0d52e3bdee6e tempest-VolumeTypesAccessTest-779490948 None] Created volume successfully.
Apr 09 13:33:23 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.760s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c4f5693e-aea2-471c-92bc-231ebe544ef9 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Retype volume completed successfully.
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "cinder-54e39f42-bcee-4c13-b35d-3a86e06fd1ba-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "cinder-54e39f42-bcee-4c13-b35d-3a86e06fd1ba-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "cinder-quobyte-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "cinder-quobyte-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc24634-7152-438c-9818-b356d8b5e195]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:24 devstack sudo[85177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba
Apr 09 13:33:24 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Acquiring lock "cinder-095ae32f-9df0-4170-b1ab-acffffeb81d2-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "cinder-095ae32f-9df0-4170-b1ab-acffffeb81d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Acquiring lock "cinder-quobyte-095ae32f-9df0-4170-b1ab-acffffeb81d2" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "cinder-quobyte-095ae32f-9df0-4170-b1ab-acffffeb81d2" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d95b27a-ddd3-48ab-a739-20169a6d5022]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:24 devstack sudo[85179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2
Apr 09 13:33:24 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:24 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" returned: 0 in 0.578s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:24 devstack sudo[85184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba
Apr 09 13:33:24 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:24 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:24 devstack sudo[85189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2
Apr 09 13:33:24 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:25 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" returned: 0 in 0.398s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "cinder-quobyte-54e39f42-bcee-4c13-b35d-3a86e06fd1ba" released by "delete_volume" :: held 1.032s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:25 devstack cinder-volume[82360]: WARNING cinder.quota [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:33:25 devstack cinder-volume[82360]: WARNING cinder.quota [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Created reservations ['c57647bc-b515-444a-8498-4626ba1b6078', '2c3e9635-ff12-4568-a516-7468d5aa80c8', '1c381932-cd92-4f78-ad0c-930fc44c4837', '907e0184-4abe-4012-b7ef-8c8f3f870f56'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:25 devstack sudo[85193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:25 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:25 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-095ae32f-9df0-4170-b1ab-acffffeb81d2" returned: 0 in 0.701s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "cinder-quobyte-095ae32f-9df0-4170-b1ab-acffffeb81d2" released by "delete_volume" :: held 1.261s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:25 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2830089 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2830089, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:33:25 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2830089 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2830089, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Created reservations ['e2feced3-732a-456e-9522-1761eeea3b01', '24bea120-6825-45c3-9e03-2eda1dcfe7a8', '27bf58c7-f545-4f8f-a35b-ec60fcaf7956', '97aa657a-b111-47ef-9f80-b8117b142ea4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:25 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.588s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:25 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Deleted volume successfully.
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-667a6d8a-1ce6-4774-a3b6-3e47038892d3 tempest-VolumeRetypeWithoutMigrationTest-66552409 None] Lock "cinder-54e39f42-bcee-4c13-b35d-3a86e06fd1ba-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:25 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:25 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:26 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.611s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:26 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Deleted volume successfully.
Apr 09 13:33:26 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e98e21c-bca8-40e7-9fe6-1ed67ee538ad tempest-VolumeTypesAccessTest-779490948 None] Lock "cinder-095ae32f-9df0-4170-b1ab-acffffeb81d2-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:35 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=68,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=9 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:33:36 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=105,cinder:SELECT=79,cinder:INSERT=19,cinder:DELETE=9 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Acquiring lock "cinder-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "cinder-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Acquiring lock "cinder-quobyte-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "cinder-quobyte-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b9447-e0f6-4236-ad1d-47d77b1c5370]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:38 devstack sudo[85340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec
Apr 09 13:33:38 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:39 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" returned: 0 in 0.920s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:39 devstack sudo[85345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec
Apr 09 13:33:39 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:40 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" returned: 0 in 1.390s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "cinder-quobyte-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec" released by "delete_volume" :: held 2.373s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Created reservations ['2f1b1596-1100-4f57-838a-d9f6526872f1', '2e01334d-a930-461c-98ad-cbfb7b554c6c', 'ff29cb76-62d2-489d-a1a1-b190d7463ae9', '1207be09-16b9-4082-9ccb-b4867c2b842a'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:41 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:41 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:41 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.764s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Deleted volume successfully.
Apr 09 13:33:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51886eef-1320-473b-b1fb-4cb361fa03c8 tempest-ServerRescueNegativeTestJSON-839467809 None] Lock "cinder-a5b78365-2c1a-43d6-bdbb-90e7a3afb9ec-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Flow 'volume_create_manager' (fab6b5af-20be-480c-bc43-43c1bf3bbb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb58da0-e263-4e2e-b69e-eda3cbeafc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb58da0-e263-4e2e-b69e-eda3cbeafc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1980028804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1897f00-93d8-48bb-9b12-b57770dc5c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f488c6b12efc4de6b3b992a2be0a74e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:44Z,use_quota=True,user_id='61c27ff0599f4e028e9f19e0349bb193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba004b4-00ad-4fe0-84e1-059331606d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba004b4-00ad-4fe0-84e1-059331606d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b76adc4-4572-47bd-9e56-7a52678e34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b76adc4-4572-47bd-9e56-7a52678e34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1897f00-93d8-48bb-9b12-b57770dc5c22', 'volume_name': 'volume-b1897f00-93d8-48bb-9b12-b57770dc5c22', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52edfe28-01e8-4be1-a695-0625dca62584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52edfe28-01e8-4be1-a695-0625dca62584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d83b06-6610-4968-a5be-dbb2efce9d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:44 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Volume b1897f00-93d8-48bb-9b12-b57770dc5c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1897f00-93d8-48bb-9b12-b57770dc5c22', 'volume_size': 1}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1980028804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1897f00-93d8-48bb-9b12-b57770dc5c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f488c6b12efc4de6b3b992a2be0a74e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:44Z,use_quota=True,user_id='61c27ff0599f4e028e9f19e0349bb193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Creating volume b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:44 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:44 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 1073741824
Apr 09 13:33:44 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:45 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 1073741824" returned: 0 in 1.231s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:45 devstack sudo[85478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22
Apr 09 13:33:45 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:46 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22" returned: 0 in 0.681s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d83b06-6610-4968-a5be-dbb2efce9d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1897f00-93d8-48bb-9b12-b57770dc5c22', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4a3c5a-264e-48c3-bec1-3078657d4b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:46 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Volume volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 (b1897f00-93d8-48bb-9b12-b57770dc5c22): created successfully
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4a3c5a-264e-48c3-bec1-3078657d4b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Flow 'volume_create_manager' (fab6b5af-20be-480c-bc43-43c1bf3bbb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3d3465bf-1faa-4b82-86c7-410a19e31023 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Created volume successfully.
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Creating offline snapshot 33994e34-6460-4fca-9cd5-c6c85cfe76f6 of volume b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53f2527-320e-41c1-9903-28fc506770d8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:47 devstack sudo[85482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22
Apr 09 13:33:47 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:47 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22" returned: 0 in 0.784s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:47 devstack sudo[85487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 1G
Apr 09 13:33:47 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:48 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 1G" returned: 0 in 1.023s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:48 devstack sudo[85492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6
Apr 09 13:33:48 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:49 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6" returned: 0 in 0.732s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:49 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 is being set with open permissions: ugo+rw
Apr 09 13:33:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:49 devstack sudo[85502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6
Apr 09 13:33:49 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:50 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6" returned: 0 in 0.746s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:50 devstack sudo[85506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info
Apr 09 13:33:50 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:51 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info" returned: 0 in 0.876s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:51 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info is being set with open permissions: ugo+rw
Apr 09 13:33:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:51 devstack sudo[85534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info
Apr 09 13:33:51 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:51 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.info" returned: 0 in 0.609s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.909s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d17472b5-da1d-4c9a-8799-a50bfb77b00f tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Create snapshot completed successfully
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "cinder-33994e34-6460-4fca-9cd5-c6c85cfe76f6-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-33994e34-6460-4fca-9cd5-c6c85cfe76f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "cinder-quobyte-33994e34-6460-4fca-9cd5-c6c85cfe76f6" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-33994e34-6460-4fca-9cd5-c6c85cfe76f6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Deleting offline snapshot 33994e34-6460-4fca-9cd5-c6c85cfe76f6 of volume b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] snapshot_file for this snap is: volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a097f-3c9d-4041-b567-866ede0e778f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:52 devstack sudo[85539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6
Apr 09 13:33:52 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:53 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6" returned: 0 in 0.537s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1897f00-93d8-48bb-9b12-b57770dc5c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:33:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c1881-7e43-488c-8e93-f853d87f5854]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:53 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22
Apr 09 13:33:53 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:54 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22" returned: 0 in 0.723s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:54 devstack sudo[85550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6
Apr 09 13:33:54 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:54 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6" returned: 0 in 0.616s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:54 devstack sudo[85555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6
Apr 09 13:33:54 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:55 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22.33994e34-6460-4fca-9cd5-c6c85cfe76f6" returned: 0 in 0.569s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-33994e34-6460-4fca-9cd5-c6c85cfe76f6" released by "_delete_snapshot" :: held 2.527s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" released by "delete_snapshot" :: held 2.541s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:55 devstack cinder-volume[82360]: WARNING cinder.quota [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:33:55 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Created reservations ['c62379b9-af10-4e0a-9aab-c9ecfc97ed0c', 'cce023dc-be04-4f6b-a326-e827d5153d58', 'a2823909-abfb-4fef-8eb9-e7fe788a5aa3', 'd38e76a1-895f-4237-a12a-7e950da62483'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Delete snapshot completed successfully.
Apr 09 13:33:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b14b4029-64a8-471a-96e9-907cdc425f01 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-33994e34-6460-4fca-9cd5-c6c85cfe76f6-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "cinder-b1897f00-93d8-48bb-9b12-b57770dc5c22-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-b1897f00-93d8-48bb-9b12-b57770dc5c22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" acquired by "delete_volume" :: waited 0.024s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f557d-a5db-4cfd-a36c-2381d0cb1cf7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:56 devstack sudo[85562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22
Apr 09 13:33:56 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:56 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Flow 'volume_create_manager' (d672baca-4603-4c3f-b956-f3f558c249ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1586d6-b3ec-4e18-b813-af703a658c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1586d6-b3ec-4e18-b813-af703a658c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34737a5c-8f3c-48bd-a18f-b39a39f1ad55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a779ffa9a1904092ab26a44213297ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:57Z,use_quota=True,user_id='df053e50c8e84f47a2d75de65fedcc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e7858d-2fab-4d73-9986-7a652b7faf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e7858d-2fab-4d73-9986-7a652b7faf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9451f-c220-4f86-94c0-228ef1bb41fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.image.glance [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Creating Keystone auth plugin from conf {{(pid=82360) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 13:33:57 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22" returned: 0 in 1.019s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:57 devstack sudo[85582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22
Apr 09 13:33:57 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9451f-c220-4f86-94c0-228ef1bb41fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34737a5c-8f3c-48bd-a18f-b39a39f1ad55', 'volume_name': 'volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31be15df30>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd50cf-e1ec-4f5f-814c-6fffaea6037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd50cf-e1ec-4f5f-814c-6fffaea6037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2784c-6c17-4213-9ec3-5a4dd7e53f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:33:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31be15df30>}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Trying to clone 34737a5c-8f3c-48bd-a18f-b39a39f1ad55 from image eee3377f-d552-4152-8887-ebf4bcaa9490 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]). {{(pid=82360) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 13:33:57 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1897f00-93d8-48bb-9b12-b57770dc5c22" returned: 0 in 0.653s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-quobyte-b1897f00-93d8-48bb-9b12-b57770dc5c22" released by "delete_volume" :: held 1.799s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:57 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 13:33:57 devstack cinder-volume[82360]: INFO cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff112ceb-d10d-4b22-8ac4-fcdf15d8f910]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Created reservations ['67ccd37c-4dde-4b0e-b8e7-1226ad22c2ee', '2e3c3acb-5537-4911-8023-416c814ecce3', '58b13223-5cb8-4081-94a3-f3247ab041d2', 'ed3f5be7-c0d5-4a3b-bea4-c9bdd12b78a5'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:58 devstack sudo[85606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD
Apr 09 13:33:58 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:58 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:33:58 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:59 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.029s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:33:59 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Deleted volume successfully.
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD" returned: 0 in 1.133s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 is fetched for user df053e50c8e84f47a2d75de65fedcc8e. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c24c478-cf28-4709-aa4c-b49394a34500 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003578009 None] Lock "cinder-b1897f00-93d8-48bb-9b12-b57770dc5c22-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff8626-c63b-45bd-bb6b-e01fe99625fb]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:59 devstack sudo[85616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD
Apr 09 13:33:59 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:33:59 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:33:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34737a5c-8f3c-48bd-a18f-b39a39f1ad55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a779ffa9a1904092ab26a44213297ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:57Z,use_quota=True,user_id='df053e50c8e84f47a2d75de65fedcc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Creating volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:33:59 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:33:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:33:59 devstack sudo[85621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1073741824
Apr 09 13:33:59 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:00 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1073741824" returned: 0 in 0.821s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:00 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:00 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:01 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Attempting download of eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d9a9e4-adf7-472f-a661-6b7c4252f7f6]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:01 devstack sudo[85644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz
Apr 09 13:34:01 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:02 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz" returned: 0 in 0.874s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:02 devstack sudo[85648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz
Apr 09 13:34:02 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:02 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz" returned: 1 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_spmpgdmz' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1755a7-3da0-4863-ada4-038bc5aba24c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:02 devstack sudo[85652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD
Apr 09 13:34:02 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:03 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:03 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] eee3377f-d552-4152-8887-ebf4bcaa9490 was qcow2, converting to raw {{(pid=82360) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 13:34:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:03 devstack sudo[85657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:03 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:04 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 1.348s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:04 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_2oxawficdevstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:34:04 devstack cinder-volume[82360]: INFO cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Converted 112.00 MB image at 82.99 MB/s
Apr 09 13:34:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:04 devstack sudo[85671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1G
Apr 09 13:34:04 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:05 devstack sudo[85673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:05 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:05 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 1G" returned: 0 in 0.797s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6856d5-3fbc-4c89-8d4e-dde9f0de028b]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:05 devstack sudo[85679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:05 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:06 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.899s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:06 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:06 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 1.322s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:07 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:07 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:07 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 1 in 0.996s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Downloaded image eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55 successfully. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 for user df053e50c8e84f47a2d75de65fedcc8e is deleted. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Marking volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55 as bootable. {{(pid=82360) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Copying metadata from image eee3377f-d552-4152-8887-ebf4bcaa9490 to 34737a5c-8f3c-48bd-a18f-b39a39f1ad55. {{(pid=82360) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 13:34:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Creating volume glance metadata for volume 34737a5c-8f3c-48bd-a18f-b39a39f1ad55 backed by image eee3377f-d552-4152-8887-ebf4bcaa9490 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82360) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Flow 'volume_create_manager' (8d947abd-964d-4935-bd96-c8c3e3f70dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d7cad2-1743-4579-aaaa-01bb1ba7ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2784c-6c17-4213-9ec3-5a4dd7e53f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31be15df30>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917b8ca-2841-468f-8d8f-78620472f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d7cad2-1743-4579-aaaa-01bb1ba7ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2006785601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f3a7b4-06f5-4e77-82b7-ee44a324358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c0d8878ebe4fc380e9c35ca4b53b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:08Z,use_quota=True,user_id='e56ee62492d64a6aa9435ee4d9021aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675b44e9-4d66-4f45-b4a5-15ed4919a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675b44e9-4d66-4f45-b4a5-15ed4919a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba55a7c-1836-4942-8a63-66218507b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba55a7c-1836-4942-8a63-66218507b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f3a7b4-06f5-4e77-82b7-ee44a324358e', 'volume_name': 'volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75abe5c-04c5-4686-a3de-baadcc4ac5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75abe5c-04c5-4686-a3de-baadcc4ac5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b5231-c11e-4fd5-b8d4-c6520339311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Volume 69f3a7b4-06f5-4e77-82b7-ee44a324358e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e', 'volume_size': 1}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2006785601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f3a7b4-06f5-4e77-82b7-ee44a324358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c0d8878ebe4fc380e9c35ca4b53b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:08Z,use_quota=True,user_id='e56ee62492d64a6aa9435ee4d9021aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Creating volume 69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:08 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Volume volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 (34737a5c-8f3c-48bd-a18f-b39a39f1ad55): created successfully
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917b8ca-2841-468f-8d8f-78620472f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Flow 'volume_create_manager' (d672baca-4603-4c3f-b956-f3f558c249ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:08 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e 1073741824
Apr 09 13:34:08 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:08 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-86b46d66-d670-4a44-ba63-32d2f6cf7084 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Created volume successfully.
Apr 09 13:34:09 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e 1073741824" returned: 0 in 0.953s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:09 devstack sudo[85696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e
Apr 09 13:34:09 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:10 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e" returned: 0 in 0.778s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.107s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b5231-c11e-4fd5-b8d4-c6520339311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b34b69-a890-4ef8-b9b6-1eaab251153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a08509-ea0f-4cc3-b6eb-bdcc7960657d]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Volume volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e (69f3a7b4-06f5-4e77-82b7-ee44a324358e): created successfully
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b34b69-a890-4ef8-b9b6-1eaab251153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Flow 'volume_create_manager' (8d947abd-964d-4935-bd96-c8c3e3f70dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-3110b4ea-cbb4-4105-9a13-7e2f1b02b82b req-a22aeda8-c336-42b8-9ddf-85c685c8c2b6 tempest-VolumesSnapshotsTestJSON-1715425120 None] Created volume successfully.
Apr 09 13:34:10 devstack sudo[85707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:10 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (d00a693e-116b-41eb-8c8a-70ca04d28714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed1991-2a70-45d8-a0be-5fd6cfca3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed1991-2a70-45d8-a0be-5fd6cfca3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059532738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2653d415-4197-4562-b1e2-f341ee282066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73942f547c4ce0990674cec94333e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:10Z,use_quota=True,user_id='5777fc8ea5864034b3e4f9cbeec930a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50ecfc3-2184-4858-b5ae-e99968102c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50ecfc3-2184-4858-b5ae-e99968102c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445cf0ad-8116-4b51-8821-cf35ad6af2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445cf0ad-8116-4b51-8821-cf35ad6af2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2653d415-4197-4562-b1e2-f341ee282066', 'volume_name': 'volume-2653d415-4197-4562-b1e2-f341ee282066', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9fe4a8-9442-4729-8c98-4fc470929659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9fe4a8-9442-4729-8c98-4fc470929659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af679cc3-2416-45f3-94bf-e65137efe6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Volume 2653d415-4197-4562-b1e2-f341ee282066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2653d415-4197-4562-b1e2-f341ee282066', 'volume_size': 1}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:11 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 1.307s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:11 devstack sudo[85711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:11 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:12 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 1 in 0.783s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.178s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059532738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2653d415-4197-4562-b1e2-f341ee282066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73942f547c4ce0990674cec94333e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:10Z,use_quota=True,user_id='5777fc8ea5864034b3e4f9cbeec930a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Creating volume 2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:12 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48', 'name': 'volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dd452c6-0152-4ff4-b7cd-b20883f8a93f', 'enforce_multipath': True} {{(pid=82360) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 13:34:12 devstack sudo[85716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 1073741824
Apr 09 13:34:12 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-bd9e2f10-0464-4c24-ab2f-01383c4ee0a2 req-b17d7616-6f39-42d6-be40-5b9ac54f3792 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] attachment_update completed successfully.
Apr 09 13:34:12 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 1073741824" returned: 0 in 0.626s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:12 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:12 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:13 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.532s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af679cc3-2416-45f3-94bf-e65137efe6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2653d415-4197-4562-b1e2-f341ee282066', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd1e805-e3f5-4372-8216-b1d8a5fbb0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Creating offline snapshot 7f1fbd99-130c-4a3c-9bee-52ad342fdf79 of volume 69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:34:13 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Volume volume-2653d415-4197-4562-b1e2-f341ee282066 (2653d415-4197-4562-b1e2-f341ee282066): created successfully
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd1e805-e3f5-4372-8216-b1d8a5fbb0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (d00a693e-116b-41eb-8c8a-70ca04d28714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de19ac-bfbe-4adc-bd29-07cf96dc06fa]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8ef5731d-8928-45bf-b900-8f9e58a28264 tempest-VolumesDeleteCascade-1270060848 None] Created volume successfully.
Apr 09 13:34:13 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e
Apr 09 13:34:13 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:14 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e" returned: 0 in 0.648s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:14 devstack sudo[85732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 1G
Apr 09 13:34:14 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:14 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 1G" returned: 0 in 0.541s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:14 devstack sudo[85738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79
Apr 09 13:34:14 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:15 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79" returned: 0 in 0.497s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:15 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 is being set with open permissions: ugo+rw
Apr 09 13:34:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:15 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79
Apr 09 13:34:15 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:15 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79" returned: 0 in 0.435s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:15 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info
Apr 09 13:34:15 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:16 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:16 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info is being set with open permissions: ugo+rw
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:16 devstack sudo[85753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info
Apr 09 13:34:16 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:16 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.info" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.584s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Creating offline snapshot 399c543e-d4b5-4a4d-acec-0256f9c46730 of volume 2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:34:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-80bcf89f-6987-4791-b618-0dbed7c36b8c req-8ac112ae-3bab-4f69-b02e-1ad74f8772a5 tempest-VolumesSnapshotsTestJSON-1715425120 None] Create snapshot completed successfully
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7564a8e-5ffa-4365-af09-bef079fad8a2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:16 devstack sudo[85756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:16 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:17 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.721s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:17 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 1G
Apr 09 13:34:17 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "cinder-7f1fbd99-130c-4a3c-9bee-52ad342fdf79-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-7f1fbd99-130c-4a3c-9bee-52ad342fdf79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "cinder-quobyte-7f1fbd99-130c-4a3c-9bee-52ad342fdf79" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-7f1fbd99-130c-4a3c-9bee-52ad342fdf79" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Deleting offline snapshot 7f1fbd99-130c-4a3c-9bee-52ad342fdf79 of volume 69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] snapshot_file for this snap is: volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9be858-f6da-479c-adb4-ffbd1257dd5d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:17 devstack sudo[85790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79
Apr 09 13:34:17 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:18 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 1G" returned: 0 in 0.734s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:18 devstack sudo[85795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:18 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:18 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79" returned: 0 in 0.768s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a49b0a-33cc-497d-bbd8-e643465d75ff]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:18 devstack sudo[85800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e
Apr 09 13:34:18 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:18 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.712s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:18 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 is being set with open permissions: ugo+rw
Apr 09 13:34:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:18 devstack sudo[85805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:18 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:19 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.667s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:19 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e" returned: 0 in 0.976s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:19 devstack sudo[85812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info
Apr 09 13:34:19 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:19 devstack sudo[85813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79
Apr 09 13:34:19 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:20 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79" returned: 0 in 0.980s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:20 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79
Apr 09 13:34:20 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:20 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info" returned: 0 in 1.130s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:20 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info is being set with open permissions: ugo+rw
Apr 09 13:34:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:20 devstack sudo[85823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info
Apr 09 13:34:20 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:21 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e.7f1fbd99-130c-4a3c-9bee-52ad342fdf79" returned: 0 in 1.116s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-7f1fbd99-130c-4a3c-9bee-52ad342fdf79" released by "_delete_snapshot" :: held 3.975s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" released by "delete_snapshot" :: held 3.996s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG cinder.quota [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Created reservations ['7d2fd89d-5f54-499a-af72-f6299a8e5365', '750983db-202a-4fe4-9de0-236a3cd3a364', 'be1a8117-88ad-4ec1-8c8c-b8a8f7699f3b', '46cf8fb3-ddb2-4407-83af-ff88f818d705'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Delete snapshot completed successfully.
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-f8f9e64b-a491-4445-bddb-594f8d3e19a1 req-dc50887f-4f73-4ad4-8b86-103e05eea1cc tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-7f1fbd99-130c-4a3c-9bee-52ad342fdf79-delete_snapshot" released by "delete_snapshot" :: held 4.155s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:21 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.info" returned: 0 in 1.216s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.259s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6d9f0181-d4b1-49d4-acec-e6d0f7e5a934 tempest-VolumesDeleteCascade-1270060848 None] Create snapshot completed successfully
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "cinder-69f3a7b4-06f5-4e77-82b7-ee44a324358e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-69f3a7b4-06f5-4e77-82b7-ee44a324358e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce788fa-76f0-46ca-827e-f0f68f11140e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:22 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e
Apr 09 13:34:22 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Creating offline snapshot cf1d0490-bdd0-49bb-8932-07d31ca0d717 of volume 2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a698b9-6b18-41b7-a0c4-263611374247]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:22 devstack sudo[85846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:22 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:22 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e" returned: 0 in 0.828s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:22 devstack sudo[85851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e
Apr 09 13:34:22 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:23 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.610s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653d415-4197-4562-b1e2-f341ee282066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:23 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 1G
Apr 09 13:34:23 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:23 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69f3a7b4-06f5-4e77-82b7-ee44a324358e" returned: 0 in 0.453s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-quobyte-69f3a7b4-06f5-4e77-82b7-ee44a324358e" released by "delete_volume" :: held 1.325s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG cinder.quota [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Created reservations ['1e6c6186-9a29-4df4-acdc-3f6cb2d82afa', '82395c42-877d-4314-bf5d-153955ce368c', '03b8c9c8-f9ad-4c62-ad36-e7b643e7aa8b', '22a6e952-2a47-44d6-a14d-39b55258bcca'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:23 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:23 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:23 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 1G" returned: 0 in 0.597s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:23 devstack sudo[85864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:23 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:24 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.638s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG cinder.manager [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Deleted volume successfully.
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-43fc8269-1ded-4c23-bc94-c8b7602a8910 req-5cc709a6-34be-41a6-ba63-458a80d8c8d9 tempest-VolumesSnapshotsTestJSON-1715425120 None] Lock "cinder-69f3a7b4-06f5-4e77-82b7-ee44a324358e-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:24 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 0.569s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:24 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 is being set with open permissions: ugo+rw
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:24 devstack sudo[85870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:24 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:24 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 0.556s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69497061-2e4b-46a6-96fa-7d80de50b470 tempest-VolumesDeleteCascade-1270060848 None] Create snapshot completed successfully
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-2653d415-4197-4562-b1e2-f341ee282066-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-2653d415-4197-4562-b1e2-f341ee282066-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Performing cascade delete. {{(pid=82360) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-399c543e-d4b5-4a4d-acec-0256f9c46730-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-399c543e-d4b5-4a4d-acec-0256f9c46730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-399c543e-d4b5-4a4d-acec-0256f9c46730" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-399c543e-d4b5-4a4d-acec-0256f9c46730" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Deleting offline snapshot 399c543e-d4b5-4a4d-acec-0256f9c46730 of volume 2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] snapshot_file for this snap is: volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22e0058-28a9-46ae-8a78-8340fd0f9cba]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:25 devstack sudo[85904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:25 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:26 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.541s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653d415-4197-4562-b1e2-f341ee282066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:26 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d0a81-7ce2-4973-9069-f6d4a022910d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:26 devstack sudo[85909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:26 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:27 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 1.073s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f10bca-c58f-4377-9c8b-c34fbd1f5fd2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:27 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:27 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89e72af9-d0fd-433e-b2c3-65180e26620c tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-812611259: creating
Apr 09 13:34:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89e72af9-d0fd-433e-b2c3-65180e26620c tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-812611259: created successfully
Apr 09 13:34:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89e72af9-d0fd-433e-b2c3-65180e26620c tempest-GroupSnapshotsTest-982305852 None] Create group completed successfully.
Apr 09 13:34:28 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 0.634s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653d415-4197-4562-b1e2-f341ee282066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[20045a5b-0247-4608-9e75-ccb6c82eb362]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:28 devstack sudo[85970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:28 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:28 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.569s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653d415-4197-4562-b1e2-f341ee282066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea1d28-8c51-4952-9164-651cb1797648]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:28 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:28 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (8039d3e1-072e-42b3-a6d0-9dbe5d051c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d5f99-612e-416b-a12a-a103c081f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d5f99-612e-416b-a12a-a103c081f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-79096903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c35cd9d-55be-4b1b-a4c7-7b5151a9787f,host='devstack@QuobyteHD#QuobyteHD',id=3651b52c-71d2-4539-94e7-b6248026b87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d428f6c9-f911-49f2-bb17-295c68952ffb),volume_type_id=d428f6c9-f911-49f2-bb17-295c68952ffb)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39f070a-f265-4718-af4c-e80c3200ec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39f070a-f265-4718-af4c-e80c3200ec9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514d8b28-a99d-44eb-8d3a-993697a2a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514d8b28-a99d-44eb-8d3a-993697a2a32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3651b52c-71d2-4539-94e7-b6248026b87b', 'volume_name': 'volume-3651b52c-71d2-4539-94e7-b6248026b87b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779bc522-66f2-478a-912e-cd348bceacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779bc522-66f2-478a-912e-cd348bceacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ead7e7-4299-4415-8ea8-5ef89b0edaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:29 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Volume 3651b52c-71d2-4539-94e7-b6248026b87b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3651b52c-71d2-4539-94e7-b6248026b87b', 'volume_size': 1}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9c35cd9d-55be-4b1b-a4c7-7b5151a9787f,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-79096903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c35cd9d-55be-4b1b-a4c7-7b5151a9787f,host='devstack@QuobyteHD#QuobyteHD',id=3651b52c-71d2-4539-94e7-b6248026b87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d428f6c9-f911-49f2-bb17-295c68952ffb),volume_type_id=d428f6c9-f911-49f2-bb17-295c68952ffb)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Creating volume 3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:29 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:29 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b 1073741824
Apr 09 13:34:29 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:29 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.634s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:29 devstack sudo[85983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:29 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:29 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b 1073741824" returned: 0 in 0.609s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:29 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:29 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (fb9ea01f-7bd6-4d70-b09a-8f593f3828c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b716921-00a7-4f2b-b5f3-42606a56ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b716921-00a7-4f2b-b5f3-42606a56ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244979364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e61612-3513-4d2b-95c0-badab31044ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:30Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d600fc-22ac-4cd2-a722-775568351aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d600fc-22ac-4cd2-a722-775568351aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe63ec-c3b0-432a-a3f8-6b51ee21f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe63ec-c3b0-432a-a3f8-6b51ee21f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e61612-3513-4d2b-95c0-badab31044ed', 'volume_name': 'volume-53e61612-3513-4d2b-95c0-badab31044ed', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f7f2fa-2f13-4296-88f3-47cf09acca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f7f2fa-2f13-4296-88f3-47cf09acca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f765a6-c3ea-441c-af25-4f10e3b3ec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Volume 53e61612-3513-4d2b-95c0-badab31044ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e61612-3513-4d2b-95c0-badab31044ed', 'volume_size': 1}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.793s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:30 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730
Apr 09 13:34:30 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:30 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.221s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244979364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e61612-3513-4d2b-95c0-badab31044ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:30Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Creating volume 53e61612-3513-4d2b-95c0-badab31044ed {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:30 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:30 devstack sudo[85997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed 1073741824
Apr 09 13:34:30 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ead7e7-4299-4415-8ea8-5ef89b0edaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3651b52c-71d2-4539-94e7-b6248026b87b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51672a2-f6a2-41a3-acf0-8fc0ea6bab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:30 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Volume volume-3651b52c-71d2-4539-94e7-b6248026b87b (3651b52c-71d2-4539-94e7-b6248026b87b): created successfully
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51672a2-f6a2-41a3-acf0-8fc0ea6bab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (8039d3e1-072e-42b3-a6d0-9dbe5d051c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c440881b-7043-48b0-86c0-47c730320ed6 tempest-GroupSnapshotsTest-982305852 None] Created volume successfully.
Apr 09 13:34:30 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.399c543e-d4b5-4a4d-acec-0256f9c46730" returned: 0 in 0.442s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 -F qcow2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:30 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 -F qcow2
Apr 09 13:34:30 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:30 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed 1073741824" returned: 0 in 0.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:30 devstack sudo[86005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed
Apr 09 13:34:30 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:31 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653d415-4197-4562-b1e2-f341ee282066 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 -F qcow2" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-399c543e-d4b5-4a4d-acec-0256f9c46730" released by "_delete_snapshot" :: held 5.293s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" released by "delete_snapshot" :: held 5.316s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['8d7c925e-b38d-4b9c-b433-9f4eff945b66', '3ed604ba-0192-462e-b19b-24c7de192a50', '4a61b404-1750-4e34-b4d2-3fd4150a53aa', '050b1be3-3576-4144-b13c-1f37a9e44ce6'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Delete snapshot completed successfully.
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-399c543e-d4b5-4a4d-acec-0256f9c46730-delete_snapshot" released by "delete_snapshot" :: held 5.428s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-cf1d0490-bdd0-49bb-8932-07d31ca0d717-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-cf1d0490-bdd0-49bb-8932-07d31ca0d717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-cf1d0490-bdd0-49bb-8932-07d31ca0d717" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-cf1d0490-bdd0-49bb-8932-07d31ca0d717" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Deleting offline snapshot cf1d0490-bdd0-49bb-8932-07d31ca0d717 of volume 2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] snapshot_file for this snap is: volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bae548-5033-4bd3-9b1b-0a903d477b43]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:31 devstack sudo[86026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:31 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:31 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed" returned: 0 in 0.618s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f765a6-c3ea-441c-af25-4f10e3b3ec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e61612-3513-4d2b-95c0-badab31044ed', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cf0cc3-b196-4452-adef-aca7df7726b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Volume volume-53e61612-3513-4d2b-95c0-badab31044ed (53e61612-3513-4d2b-95c0-badab31044ed): created successfully
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cf0cc3-b196-4452-adef-aca7df7726b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (fb9ea01f-7bd6-4d70-b09a-8f593f3828c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4563deea-b6b9-4893-b801-72b0b857cddb tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:34:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] GroupSnapshot 21db37ea-eb00-4212-a496-109044cc03bb: creating.
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Group snapshot 21db37ea-eb00-4212-a496-109044cc03bb: creating. {{(pid=82360) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Creating offline snapshot 0ce9bd0d-6f8f-464c-bcd0-717751f405bd of volume 3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[752cbc01-a689-4643-9d5a-69eedb982eea]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:31 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:31 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-73e488fc-dfe2-485f-ba77-73490bd0d435 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed" by "attach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-73e488fc-dfe2-485f-ba77-73490bd0d435 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed" acquired by "attach_volume" :: waited 0.038s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-73e488fc-dfe2-485f-ba77-73490bd0d435 tempest-VolumesActionsTest-468022988 None] Attaching volume 53e61612-3513-4d2b-95c0-badab31044ed to instance 24b59e1d-68f3-40ab-8bfc-6603b3b549e5 at mountpoint /dev/vdb on host None.
Apr 09 13:34:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-73e488fc-dfe2-485f-ba77-73490bd0d435 tempest-VolumesActionsTest-468022988 None] Attach volume completed successfully.
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-73e488fc-dfe2-485f-ba77-73490bd0d435 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed" released by "attach_volume" :: held 0.163s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:32 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 0.876s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:32 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd 1G
Apr 09 13:34:32 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:32 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 1.330s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653d415-4197-4562-b1e2-f341ee282066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69f474-9419-4f9d-861d-7a9d8039ec5a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:32 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:32 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:33 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.721s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:33 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd 1G" returned: 0 in 0.785s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651b52c-71d2-4539-94e7-b6248026b87b -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:33 devstack sudo[86072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651b52c-71d2-4539-94e7-b6248026b87b -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:33 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:33 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:33 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Terminate volume connection completed successfully.
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" by "detach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:33 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 0.656s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Detaching volume 53e61612-3513-4d2b-95c0-badab31044ed from instance 24b59e1d-68f3-40ab-8bfc-6603b3b549e5.
Apr 09 13:34:33 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717
Apr 09 13:34:33 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Detach volume completed successfully.
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69f4aa17-8e26-4edc-af0c-2d3f1e6a7515 tempest-VolumesActionsTest-83802475 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:34 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651b52c-71d2-4539-94e7-b6248026b87b -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.867s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:34 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:34 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:34 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:34 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066.cf1d0490-bdd0-49bb-8932-07d31ca0d717" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-cf1d0490-bdd0-49bb-8932-07d31ca0d717" released by "_delete_snapshot" :: held 3.356s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" released by "delete_snapshot" :: held 3.368s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-07c6a791-f2ba-4f52-9781-302420681263 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" by "detach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-07c6a791-f2ba-4f52-9781-302420681263 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-07c6a791-f2ba-4f52-9781-302420681263 tempest-VolumesActionsTest-468022988 None] Volume detach called, but volume not attached.
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['d9780f5f-9a14-4acc-8de8-e1cdde234623', 'ef772b09-b443-40ea-8407-4cd1949e67cc', '4d137553-afe5-428e-9ce7-5665e0a64d99', '81e1a382-62f2-4e76-846c-7e556849cad4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-07c6a791-f2ba-4f52-9781-302420681263 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Delete snapshot completed successfully.
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-cf1d0490-bdd0-49bb-8932-07d31ca0d717-delete_snapshot" released by "delete_snapshot" :: held 3.518s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Snapshots deleted, issuing volume delete {{(pid=82360) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ad57e6-bd7a-49e2-8307-b9d0b97a68ba]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:34 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:34 devstack sudo[86090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info
Apr 09 13:34:34 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:34 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:34 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:35 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info" returned: 0 in 0.658s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:35 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:35 devstack sudo[86097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info
Apr 09 13:34:35 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:35 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-quobyte-53e61612-3513-4d2b-95c0-badab31044ed" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.868s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:35 devstack sudo[86099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066
Apr 09 13:34:35 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "cinder-quobyte-53e61612-3513-4d2b-95c0-badab31044ed" acquired by "delete_volume" :: waited 0.062s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8e479d-fc9e-4e99-950f-868af43daf68]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:35 devstack sudo[86102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed
Apr 09 13:34:35 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:36 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.info" returned: 0 in 0.684s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=79,cinder:SELECT=91,cinder:INSERT=19,cinder:DELETE=5 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:34:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-23d24b4e-43a3-426d-9517-4003d74cfe89 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 21db37ea-eb00-4212-a496-109044cc03bb: created successfully
Apr 09 13:34:36 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2653d415-4197-4562-b1e2-f341ee282066" returned: 0 in 0.711s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-2653d415-4197-4562-b1e2-f341ee282066" released by "delete_volume" :: held 1.629s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:36 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed" returned: 0 in 0.678s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:36 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed
Apr 09 13:34:36 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['eefdd863-eb99-445d-92d2-7be6d03279a6', '02654303-94b2-4f38-b19b-fb1d7158be9a', 'a5ec0571-a699-4038-82f6-00a36cd09cbc', '5da08fe1-30b4-41d8-873e-d817f081d9f7'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:36 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:36 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:36 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-53e61612-3513-4d2b-95c0-badab31044ed" returned: 0 in 0.650s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "cinder-quobyte-53e61612-3513-4d2b-95c0-badab31044ed" released by "delete_volume" :: held 1.361s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:36 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=94,cinder:INSERT=37,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Created reservations ['c6bf5003-ec2b-4453-8144-d13d6cb50ba4', 'ea035d27-cf27-474d-8cdc-02c55bb37e69', 'dcf14546-ae83-4fd2-997e-78a14c348f51', '40674081-05de-4446-b283-728f57861da6'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:37 devstack sudo[86135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:37 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:37 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (8d58c266-cd4c-4132-aa16-df4ad062a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb9212e-1cc1-4076-ad72-29665ace366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.056s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb9212e-1cc1-4076-ad72-29665ace366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-154859860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ad6fec-6a78-4a21-bd30-2ebcb91e08b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73942f547c4ce0990674cec94333e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:37Z,use_quota=True,user_id='5777fc8ea5864034b3e4f9cbeec930a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4b795c-12a1-4285-99d9-e5411864527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4b795c-12a1-4285-99d9-e5411864527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c467da-7031-4970-bc8c-b624ffb063bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c467da-7031-4970-bc8c-b624ffb063bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ad6fec-6a78-4a21-bd30-2ebcb91e08b9', 'volume_name': 'volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325d2b8-8b7e-4339-886a-a8a01449d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325d2b8-8b7e-4339-886a-a8a01449d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563617d-ae3a-4ca3-baac-fc53a5205dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:37 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Volume 23ad6fec-6a78-4a21-bd30-2ebcb91e08b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9', 'volume_size': 1}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-154859860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ad6fec-6a78-4a21-bd30-2ebcb91e08b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73942f547c4ce0990674cec94333e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:37Z,use_quota=True,user_id='5777fc8ea5864034b3e4f9cbeec930a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Creating volume 23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:37 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Deleted volume successfully.
Apr 09 13:34:37 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 1073741824
Apr 09 13:34:37 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-89cc0bb4-e62c-4c82-b7aa-601dbb0c43e1 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-2653d415-4197-4562-b1e2-f341ee282066-delete_volume" released by "delete_volume" :: held 11.937s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:37 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.727s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Deleted volume successfully.
Apr 09 13:34:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dded008b-a2ec-4efd-b7f5-c40a27f41229 tempest-VolumesActionsTest-468022988 None] Lock "cinder-53e61612-3513-4d2b-95c0-badab31044ed-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:38 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 1073741824" returned: 0 in 1.190s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:38 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:38 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:39 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.722s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.735s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563617d-ae3a-4ca3-baac-fc53a5205dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0fc25a-487d-4730-8eb1-c82c573b0b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:39 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Volume volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 (23ad6fec-6a78-4a21-bd30-2ebcb91e08b9): created successfully
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0fc25a-487d-4730-8eb1-c82c573b0b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (8d58c266-cd4c-4132-aa16-df4ad062a023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-75ce5a6b-f8ea-42f4-9738-5e0a7619163e tempest-VolumesDeleteCascade-1270060848 None] Created volume successfully.
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Creating volume 0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d from snapshot 0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] snapshot: 0ce9bd0d-6f8f-464c-bcd0-717751f405bd, volume: 0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06df831-31c8-47d8-a247-2848afa5c615]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:39 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:39 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:40 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.754s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3651b52c-71d2-4539-94e7-b6248026b87b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c27e90-175b-4a1c-86dd-031c1db627e5]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:40 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:40 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:41 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 0.678s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:41 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:34:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:41 devstack sudo[86216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d
Apr 09 13:34:41 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:43 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" returned: 0 in 2.675s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa07e384-9fc7-4bdc-b612-99392678fcda]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:43 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:43 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:44 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 0.600s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:34:44 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Converted 1024.00 MB image at 382.61 MB/s
Apr 09 13:34:44 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:44 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d
Apr 09 13:34:44 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:44 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" released by "_copy_volume_from_snapshot" :: held 5.275s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" released by "_create_volume_from_snapshot" :: held 5.302s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.354s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.188s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Creating offline snapshot 06c1d5c0-e255-42a3-ba67-2d244170fbb2 of volume 23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb44603-611e-4af6-a73a-9fc9218e1fa2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:44 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:45 devstack sudo[86306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:45 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (6211eeb4-3147-4abc-9250-13c41b9903ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9a1c18-29a2-4c77-b4a4-54508dde30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9a1c18-29a2-4c77-b4a4-54508dde30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-678360545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b23d143-5428-471d-8dc0-dbe052943ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:45Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c2b921-a887-4ad7-aa9d-59c3c1046134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c2b921-a887-4ad7-aa9d-59c3c1046134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f7232-592e-48fe-aca1-2126f42a0ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f7232-592e-48fe-aca1-2126f42a0ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b23d143-5428-471d-8dc0-dbe052943ab1', 'volume_name': 'volume-6b23d143-5428-471d-8dc0-dbe052943ab1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eff3ef-9324-4e73-b22c-6db8a0c78eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eff3ef-9324-4e73-b22c-6db8a0c78eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e4bf9a-a0d2-465b-8b1c-f4c99e48883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:45 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Volume 6b23d143-5428-471d-8dc0-dbe052943ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b23d143-5428-471d-8dc0-dbe052943ab1', 'volume_size': 1}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-cc2680bb-3c67-4184-956d-9de60d077fb4 tempest-GroupSnapshotsTest-982305852 None] Create group from source-snapshot-21db37ea-eb00-4212-a496-109044cc03bb completed successfully.
Apr 09 13:34:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-8303ce61-09f4-4723-a495-11e40ffb911a tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Terminate volume connection completed successfully.
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-8303ce61-09f4-4723-a495-11e40ffb911a tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Deleting attachment 3dd452c6-0152-4ff4-b7cd-b20883f8a93f. {{(pid=82360) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 13:34:45 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.519s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:45 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 1G
Apr 09 13:34:45 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5fc423-8f5b-4d0c-8fee-0929cde58d76]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:45 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d
Apr 09 13:34:45 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "cinder-34737a5c-8f3c-48bd-a18f-b39a39f1ad55-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-34737a5c-8f3c-48bd-a18f-b39a39f1ad55-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "cinder-quobyte-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-quobyte-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce2226-e9b5-4810-8cbc-217b15bb8ce3]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:45 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:45 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:46 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 1G" returned: 0 in 0.610s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:46 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:46 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:46 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" returned: 0 in 0.500s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:46 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d
Apr 09 13:34:46 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:46 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 0.592s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:46 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:46 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:46 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:46 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 is being set with open permissions: ugo+rw
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:46 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0f99a6bd-9d6b-414e-8d59-ec5cc0939a7d" released by "delete_volume" :: held 0.995s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:46 devstack sudo[86336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:46 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['879bbdc2-e774-40e7-8713-214a5e1fcc7c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:46 devstack cinder-volume[82360]: WARNING cinder.quota [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1634171316 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1634171316, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:34:46 devstack cinder-volume[82360]: WARNING cinder.quota [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1634171316 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1634171316, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['1c97113a-2c7c-45bd-9dd0-22b16c3c0c4a', '4924daf1-33a5-4c54-a59a-9c8d7b369982', '76c094c0-aa6c-43d1-9ae4-bc7c8e7645f6', 'b37bf7ab-3f40-44f6-a783-24ba04e2a1be'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:46 devstack sudo[86338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:46 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:47 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 1 in 0.581s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:47 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55
Apr 09 13:34:47 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:47 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:47 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info
Apr 09 13:34:47 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:47 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9cc1f9e0-b146-4391-bd2d-cc6fd56d5e28 tempest-GroupSnapshotsTest-982305852 None] Delete group completed successfully.
Apr 09 13:34:47 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" returned: 0 in 0.462s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-quobyte-34737a5c-8f3c-48bd-a18f-b39a39f1ad55" released by "delete_volume" :: held 1.679s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.quota [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Created reservations ['c4f58c01-8edd-495e-a101-9accc597144a', '925865b1-b3d2-482c-b57f-16ab5cc027c4', 'd23456bc-0cb8-46fd-91bc-e5f747aff10c', 'b1d8b2e6-30cf-49b0-beba-13ef4b71df12'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:47 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:47 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info is being set with open permissions: ugo+rw
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:47 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info
Apr 09 13:34:47 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:47 devstack sudo[86353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:47 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 21db37ea-eb00-4212-a496-109044cc03bb: deleting
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 21db37ea-eb00-4212-a496-109044cc03bb: deleting {{(pid=82360) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Deleting offline snapshot 0ce9bd0d-6f8f-464c-bcd0-717751f405bd of volume 3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] snapshot_file for this snap is: volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[405a830a-40a0-4462-b588-6fa8e9ae5e87]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:47 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:47 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:48 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.477s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.manager [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Deleted volume successfully.
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-eb598eaa-0258-4467-8ab1-de2f264866b0 req-1695a925-4def-4132-b283-bfaf0f896ad0 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-34737a5c-8f3c-48bd-a18f-b39a39f1ad55-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:48 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.info" returned: 0 in 0.530s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.193s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-678360545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b23d143-5428-471d-8dc0-dbe052943ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:45Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Creating volume 6b23d143-5428-471d-8dc0-dbe052943ab1 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:48 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:48 devstack sudo[86359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 1073741824
Apr 09 13:34:48 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-30baac0e-4758-4dcd-888b-9fb509a8e976 tempest-VolumesDeleteCascade-1270060848 None] Create snapshot completed successfully
Apr 09 13:34:48 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.565s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3651b52c-71d2-4539-94e7-b6248026b87b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3dddb-ddae-455c-af5d-2871afccbdcc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:48 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:48 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:48 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 1073741824" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:48 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1
Apr 09 13:34:48 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:48 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:48 devstack sudo[86374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:48 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:49 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1" returned: 0 in 0.469s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e4bf9a-a0d2-465b-8b1c-f4c99e48883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b23d143-5428-471d-8dc0-dbe052943ab1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f16d44c-b562-40c3-803c-6e4a21227381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Volume volume-6b23d143-5428-471d-8dc0-dbe052943ab1 (6b23d143-5428-471d-8dc0-dbe052943ab1): created successfully
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f16d44c-b562-40c3-803c-6e4a21227381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (6211eeb4-3147-4abc-9250-13c41b9903ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-deda4f8f-7510-43fb-985f-552b52445a64 tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (449d180d-2ea8-47e1-a5d8-022ce2b84859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0b8e5c-5aa1-4aed-8a25-f74f4eb1064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0b8e5c-5aa1-4aed-8a25-f74f4eb1064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1739900720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137d74d0-db0e-4142-b70d-bf658f583976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73942f547c4ce0990674cec94333e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06c1d5c0-e255-42a3-ba67-2d244170fbb2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:49Z,use_quota=True,user_id='5777fc8ea5864034b3e4f9cbeec930a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee24a54-5496-4e24-a9d9-a077bda45c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee24a54-5496-4e24-a9d9-a077bda45c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea33e7e2-8b8e-45ed-8c17-05ac7679e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea33e7e2-8b8e-45ed-8c17-05ac7679e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '137d74d0-db0e-4142-b70d-bf658f583976', 'volume_name': 'volume-137d74d0-db0e-4142-b70d-bf658f583976', 'volume_size': 1, 'snapshot_id': '06c1d5c0-e255-42a3-ba67-2d244170fbb2'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96af7b0-0ef6-407b-b2c3-34d406ee00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96af7b0-0ef6-407b-b2c3-34d406ee00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95a135a-2501-401d-ad78-741d6f03771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:49 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Volume 137d74d0-db0e-4142-b70d-bf658f583976: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-137d74d0-db0e-4142-b70d-bf658f583976', 'volume_size': 1, 'snapshot_id': '06c1d5c0-e255-42a3-ba67-2d244170fbb2'}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.581s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2-137d74d0-db0e-4142-b70d-bf658f583976" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2-137d74d0-db0e-4142-b70d-bf658f583976" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Creating volume 137d74d0-db0e-4142-b70d-bf658f583976 from snapshot 06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:49 devstack sudo[86381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:49 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] snapshot: 06c1d5c0-e255-42a3-ba67-2d244170fbb2, volume: 137d74d0-db0e-4142-b70d-bf658f583976,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a51791-4b89-47db-9a2a-6a4f1f24962b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:49 devstack sudo[86383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:49 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:49 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b.0ce9bd0d-6f8f-464c-bcd0-717751f405bd" returned: 0 in 0.495s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-0ce9bd0d-6f8f-464c-bcd0-717751f405bd" released by "_delete_snapshot" :: held 2.208s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" released by "delete_snapshot" :: held 2.221s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:50 devstack cinder-volume[82360]: WARNING cinder.quota [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1634171316 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1634171316, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['ec8061e0-eaf3-4035-b2a8-c27dea05fe9f', 'ee32ebdf-998f-4afe-8242-21f76d96fc8f', '18bc5e79-13d7-456d-afde-707dfd8a3e4c', 'd66aacd8-c7d8-4e54-8055-a85b22d3c432'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a03f8951-b19a-4d9f-b44a-f5e1655c7eb3 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 21db37ea-eb00-4212-a496-109044cc03bb: deleted successfully
Apr 09 13:34:50 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeef128-0bc7-4fbf-805e-eff814d72400]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:50 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:50 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-6b23d143-5428-471d-8dc0-dbe052943ab1-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "cinder-6b23d143-5428-471d-8dc0-dbe052943ab1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-quobyte-6b23d143-5428-471d-8dc0-dbe052943ab1" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-6b23d143-5428-471d-8dc0-dbe052943ab1" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3eb5a0-2d4b-4103-aaf0-1f85f27bb503]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:50 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1
Apr 09 13:34:50 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:50 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.593s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:34:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:50 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976
Apr 09 13:34:50 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:51 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1" returned: 0 in 0.669s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:51 devstack sudo[86425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1
Apr 09 13:34:51 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d0162-857c-446c-a8b7-1ce6aa44551c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:51 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:51 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:52 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 1.114s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:52 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6b23d143-5428-471d-8dc0-dbe052943ab1" returned: 0 in 1.258s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:52 devstack sudo[86445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b
Apr 09 13:34:52 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-6b23d143-5428-471d-8dc0-dbe052943ab1" released by "delete_volume" :: held 1.979s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Created reservations ['212531e7-d09b-4937-9c99-231ca4d43137', '5506636d-c8b1-4f56-bd01-736bd571a3a2', 'd1377e73-034e-4abc-8537-90c9557703bc', 'b46227d2-ce5b-4fe2-94e8-4509db4a85d8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:52 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:52 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:53 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976" returned: 0 in 2.693s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:53 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-3651b52c-71d2-4539-94e7-b6248026b87b" returned: 0 in 1.088s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5f33f-2c8f-44d9-94c9-76239d7fde2c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-3651b52c-71d2-4539-94e7-b6248026b87b" released by "delete_volume" :: held 2.239s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Created reservations ['81669f60-c000-41aa-9bdd-b839b0d58fc9'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:53 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:53 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:53 devstack cinder-volume[82360]: WARNING cinder.db.sqlalchemy.api [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1634171316']
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Created reservations ['7afe6e80-5857-42a2-89c0-d57361528178', '832db4c6-5e3e-450b-8e16-13923ca6199d', '531353ec-17b0-42a9-b79b-3c3f354b23ac', '710551c4-3aac-45aa-a98e-cc4b3edb224c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:53 devstack sudo[86455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:53 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:53 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.955s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Deleted volume successfully.
Apr 09 13:34:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a96f0ec7-a7bf-44dd-ac0b-d15d10d2e67f tempest-VolumesActionsTest-83802475 None] Lock "cinder-6b23d143-5428-471d-8dc0-dbe052943ab1-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (348d4959-1b1c-44b9-935a-155a140fcf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a1873f-6ad5-4026-a493-9f508108c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a1873f-6ad5-4026-a493-9f508108c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804070076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d43243-079e-4efb-bbd2-738f940ff7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:54Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807f9af-d87a-4ac5-a670-451c8dac5577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807f9af-d87a-4ac5-a670-451c8dac5577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d04388-958c-44a8-802f-b3c5c53f511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d04388-958c-44a8-802f-b3c5c53f511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d43243-079e-4efb-bbd2-738f940ff7d8', 'volume_name': 'volume-78d43243-079e-4efb-bbd2-738f940ff7d8', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9ee4c-9134-4e03-82e5-2874b77628ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9ee4c-9134-4e03-82e5-2874b77628ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ce696d-da56-4ddd-b0a3-ff1c5a830f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Volume 78d43243-079e-4efb-bbd2-738f940ff7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d43243-079e-4efb-bbd2-738f940ff7d8', 'volume_size': 1}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:54 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.798s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Converted 1024.00 MB image at 379.53 MB/s
Apr 09 13:34:54 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 is being set with open permissions: ugo+rw
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:54 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976
Apr 09 13:34:54 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:54 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.567s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4e2986c7-2aca-4154-b51a-74f4adce9e8a tempest-GroupSnapshotsTest-982305852 None] Delete group completed successfully.
Apr 09 13:34:54 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976" returned: 0 in 0.445s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" released by "_copy_volume_from_snapshot" :: held 5.156s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2-137d74d0-db0e-4142-b70d-bf658f583976" released by "_create_volume_from_snapshot" :: held 5.173s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.193s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804070076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d43243-079e-4efb-bbd2-738f940ff7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:54Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Creating volume 78d43243-079e-4efb-bbd2-738f940ff7d8 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:54 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 1073741824
Apr 09 13:34:54 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95a135a-2501-401d-ad78-741d6f03771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137d74d0-db0e-4142-b70d-bf658f583976', 'volume_size': 1, 'snapshot_id': '06c1d5c0-e255-42a3-ba67-2d244170fbb2'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c363d-a80f-4adf-9d33-b7d81e981521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Volume volume-137d74d0-db0e-4142-b70d-bf658f583976 (137d74d0-db0e-4142-b70d-bf658f583976): created successfully
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c363d-a80f-4adf-9d33-b7d81e981521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Flow 'volume_create_manager' (449d180d-2ea8-47e1-a5d8-022ce2b84859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c6eaa5a2-90c3-4b10-bd46-8ee6b1e519ab tempest-VolumesDeleteCascade-1270060848 None] Created volume successfully.
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b40797b7-3f6e-49b6-a43c-c3909d090fc1 tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-1368035078: creating
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b40797b7-3f6e-49b6-a43c-c3909d090fc1 tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-1368035078: created successfully
Apr 09 13:34:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b40797b7-3f6e-49b6-a43c-c3909d090fc1 tempest-GroupSnapshotsTest-982305852 None] Create group completed successfully.
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Performing cascade delete. {{(pid=82360) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-06c1d5c0-e255-42a3-ba67-2d244170fbb2-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-06c1d5c0-e255-42a3-ba67-2d244170fbb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Deleting offline snapshot 06c1d5c0-e255-42a3-ba67-2d244170fbb2 of volume 23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] snapshot_file for this snap is: volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a7ba5-41ff-497f-91f3-5aca46ac6451]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:55 devstack sudo[86472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:55 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:55 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 1073741824" returned: 0 in 0.596s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:55 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8
Apr 09 13:34:55 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:55 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.515s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab802ed-fa43-4669-90c8-90a05497a6e8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:55 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:55 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:55 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8" returned: 0 in 0.435s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ce696d-da56-4ddd-b0a3-ff1c5a830f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d43243-079e-4efb-bbd2-738f940ff7d8', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bb8661-581e-4995-acd8-2839850759af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:55 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Volume volume-78d43243-079e-4efb-bbd2-738f940ff7d8 (78d43243-079e-4efb-bbd2-738f940ff7d8): created successfully
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bb8661-581e-4995-acd8-2839850759af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (348d4959-1b1c-44b9-935a-155a140fcf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-091fecc9-8e69-4859-b0e1-cbf6e39dd733 tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:34:56 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:56 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (eae95605-709d-4a8b-81b3-4f98e7391400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49050e84-f79b-4ec3-80d9-fdf38177f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49050e84-f79b-4ec3-80d9-fdf38177f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607731722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad83cf23-1416-4b73-ac12-f07252363a03,host='devstack@QuobyteHD#QuobyteHD',id=fe4a7115-502c-4347-a538-05feac2c3940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:56Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0ec468-c018-42b8-8c2e-4caa8812079d),volume_type_id=fd0ec468-c018-42b8-8c2e-4caa8812079d)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0a8c84-2c59-4d44-92b7-3196b11f0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0a8c84-2c59-4d44-92b7-3196b11f0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc37d09-94fb-400c-a8bf-a876bdfc9b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc37d09-94fb-400c-a8bf-a876bdfc9b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4a7115-502c-4347-a538-05feac2c3940', 'volume_name': 'volume-fe4a7115-502c-4347-a538-05feac2c3940', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e2377d-cb03-46f5-ba25-e75245263585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e2377d-cb03-46f5-ba25-e75245263585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4de18f-05f5-4b37-9921-10619f34c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:56 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Volume fe4a7115-502c-4347-a538-05feac2c3940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4a7115-502c-4347-a538-05feac2c3940', 'volume_size': 1}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ad83cf23-1416-4b73-ac12-f07252363a03,created_at=2026-04-09T11:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607731722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad83cf23-1416-4b73-ac12-f07252363a03,host='devstack@QuobyteHD#QuobyteHD',id=fe4a7115-502c-4347-a538-05feac2c3940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:56Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0ec468-c018-42b8-8c2e-4caa8812079d),volume_type_id=fd0ec468-c018-42b8-8c2e-4caa8812079d)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Creating volume fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:56 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 1073741824
Apr 09 13:34:56 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-78d43243-079e-4efb-bbd2-738f940ff7d8-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "cinder-78d43243-079e-4efb-bbd2-738f940ff7d8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-quobyte-78d43243-079e-4efb-bbd2-738f940ff7d8" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-78d43243-079e-4efb-bbd2-738f940ff7d8" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8387f65-afc3-490e-8f11-aed64dd3ae65]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8
Apr 09 13:34:56 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:56 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2
Apr 09 13:34:56 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:56 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 1073741824" returned: 0 in 0.534s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940
Apr 09 13:34:56 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:56 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:56 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8
Apr 09 13:34:56 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:57 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9.06c1d5c0-e255-42a3-ba67-2d244170fbb2" returned: 0 in 0.429s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-06c1d5c0-e255-42a3-ba67-2d244170fbb2" released by "_delete_snapshot" :: held 2.064s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" released by "delete_snapshot" :: held 2.074s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['2f7f6608-ad30-4a79-9b0b-5d06bc680ba1', '8af27017-ca48-4722-b30b-6e44eda713f6', 'b3c657cb-64ac-4c24-a522-feda6285ebf9', 'f1700282-2315-40c7-8767-13de91691778'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Delete snapshot completed successfully.
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-06c1d5c0-e255-42a3-ba67-2d244170fbb2-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Snapshots deleted, issuing volume delete {{(pid=82360) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:57 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8cafd-da6b-4566-9e27-62abca0985d1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4de18f-05f5-4b37-9921-10619f34c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4a7115-502c-4347-a538-05feac2c3940', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110bfdbf-c09c-4026-be95-99f239807b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Volume volume-fe4a7115-502c-4347-a538-05feac2c3940 (fe4a7115-502c-4347-a538-05feac2c3940): created successfully
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110bfdbf-c09c-4026-be95-99f239807b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:57 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:57 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (eae95605-709d-4a8b-81b3-4f98e7391400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-29e5d961-5c40-424c-a8af-a5d1d59de291 tempest-GroupSnapshotsTest-982305852 None] Created volume successfully.
Apr 09 13:34:57 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78d43243-079e-4efb-bbd2-738f940ff7d8" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-78d43243-079e-4efb-bbd2-738f940ff7d8" released by "delete_volume" :: held 0.996s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Created reservations ['8a3b1e0f-4ce5-4da2-9df9-701c925f47b1', 'ed92ae28-3e26-42b2-a107-901a8b829701', '05bb8a72-9f2b-4c03-8ad4-809c359e54eb', 'f766c5d3-1144-41c8-b2fe-035c51c6cda5'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:57 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.473s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:57 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9
Apr 09 13:34:57 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:57 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:57 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:58 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" returned: 0 in 0.413s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9" released by "delete_volume" :: held 0.945s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['b852c4b3-5833-4562-95ca-e935285bcfb7', 'c09730b5-7776-4506-b59a-9f75dae682ba', 'c64e473f-31db-48f3-be29-38a4528a2f91', '7838761e-c94b-4292-bf3e-70d14f0ddc18'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:34:58 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Deleted volume successfully.
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-510a2a23-f9fa-4256-9e76-8533546e83ab tempest-VolumesActionsTest-83802475 None] Lock "cinder-78d43243-079e-4efb-bbd2-738f940ff7d8-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:58 devstack sudo[86524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:34:58 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (73cdde4d-023d-4169-8125-b242b67b0d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508020c6-fd8b-454b-bb6f-1a277bf809d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508020c6-fd8b-454b-bb6f-1a277bf809d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571025528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad83cf23-1416-4b73-ac12-f07252363a03,host='devstack@QuobyteHD#QuobyteHD',id=c7b636f0-ad0e-46cb-ba2d-9320a2d7af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:59Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0ec468-c018-42b8-8c2e-4caa8812079d),volume_type_id=fd0ec468-c018-42b8-8c2e-4caa8812079d)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c461e5c7-c6a1-4239-9262-f0d0d48537bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c461e5c7-c6a1-4239-9262-f0d0d48537bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4efe9b-281b-468b-882c-bc4ab61ed65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4efe9b-281b-468b-882c-bc4ab61ed65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b636f0-ad0e-46cb-ba2d-9320a2d7af44', 'volume_name': 'volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3459474-c376-4f5c-990c-f9915c3c4383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3459474-c376-4f5c-990c-f9915c3c4383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb61ce24-2904-4962-aeab-77d4eeb84a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:58 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Volume c7b636f0-ad0e-46cb-ba2d-9320a2d7af44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44', 'volume_size': 1}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ad83cf23-1416-4b73-ac12-f07252363a03,created_at=2026-04-09T11:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571025528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad83cf23-1416-4b73-ac12-f07252363a03,host='devstack@QuobyteHD#QuobyteHD',id=c7b636f0-ad0e-46cb-ba2d-9320a2d7af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:59Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0ec468-c018-42b8-8c2e-4caa8812079d),volume_type_id=fd0ec468-c018-42b8-8c2e-4caa8812079d)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Creating volume c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:58 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:58 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 1073741824
Apr 09 13:34:58 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:58 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:34:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Deleted volume successfully.
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-63034f1a-7283-422b-8a86-18fa9def87f0 tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-23ad6fec-6a78-4a21-bd30-2ebcb91e08b9-delete_volume" released by "delete_volume" :: held 3.834s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (556160dd-aeaf-4e81-bcf0-92dcf695d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8f91ed-f828-4475-8c82-03236fa64046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8f91ed-f828-4475-8c82-03236fa64046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413332249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42afa5b9-4d49-498f-9054-cb8b9de41823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:59Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb52c15f-a352-4b30-831b-e367659bfaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb52c15f-a352-4b30-831b-e367659bfaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b7e593-e5fd-4779-8bb6-c748e685b33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b7e593-e5fd-4779-8bb6-c748e685b33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42afa5b9-4d49-498f-9054-cb8b9de41823', 'volume_name': 'volume-42afa5b9-4d49-498f-9054-cb8b9de41823', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bed5c2-b034-4dcf-a0bf-431e846ac200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bed5c2-b034-4dcf-a0bf-431e846ac200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857654dd-b807-4e65-b290-6a259e4a8afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Volume 42afa5b9-4d49-498f-9054-cb8b9de41823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42afa5b9-4d49-498f-9054-cb8b9de41823', 'volume_size': 1}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:59 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 1073741824" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:59 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44
Apr 09 13:34:59 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-137d74d0-db0e-4142-b70d-bf658f583976-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-137d74d0-db0e-4142-b70d-bf658f583976-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" acquired by "delete_volume" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755df3a-7f29-4013-93b6-785b3d74f58a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:59 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976
Apr 09 13:34:59 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:59 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413332249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42afa5b9-4d49-498f-9054-cb8b9de41823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:59Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Creating volume 42afa5b9-4d49-498f-9054-cb8b9de41823 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:34:59 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:34:59 devstack sudo[86560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 1073741824
Apr 09 13:34:59 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb61ce24-2904-4962-aeab-77d4eeb84a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c999a489-00a7-420f-9f24-1f75ea0151ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:34:59 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Volume volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 (c7b636f0-ad0e-46cb-ba2d-9320a2d7af44): created successfully
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c999a489-00a7-420f-9f24-1f75ea0151ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:34:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (73cdde4d-023d-4169-8125-b242b67b0d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:34:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3cddd423-3b51-408e-9388-38e53637e971 tempest-GroupSnapshotsTest-982305852 None] Created volume successfully.
Apr 09 13:35:00 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976" returned: 0 in 0.660s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:00 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976
Apr 09 13:35:00 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:00 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 1073741824" returned: 0 in 0.602s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:00 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823
Apr 09 13:35:00 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:00 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-137d74d0-db0e-4142-b70d-bf658f583976" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-quobyte-137d74d0-db0e-4142-b70d-bf658f583976" released by "delete_volume" :: held 1.123s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Created reservations ['a73ed6c6-082b-4677-a716-0c65f960c953', '3987bf9f-741a-42ef-942b-cb408bd716df', '33def18f-ac17-4837-b2bd-381af67899ab', 'c7b30c5e-828a-4452-b7a7-628fcec28a61'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:00 devstack sudo[86576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:00 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-46723e07-5320-4e5c-8dea-22bcf45907b3 tempest-GroupSnapshotsTest-982305852 None] Update group completed successfully.
Apr 09 13:35:00 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857654dd-b807-4e65-b290-6a259e4a8afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42afa5b9-4d49-498f-9054-cb8b9de41823', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb20168-4f79-4259-b245-3cfbf08c6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:00 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Volume volume-42afa5b9-4d49-498f-9054-cb8b9de41823 (42afa5b9-4d49-498f-9054-cb8b9de41823): created successfully
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb20168-4f79-4259-b245-3cfbf08c6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (556160dd-aeaf-4e81-bcf0-92dcf695d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-74bb754b-c0fb-4f39-9513-56db66564c0f tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:35:01 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.445s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Deleted volume successfully.
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f79f411-06e1-41e3-a253-06f5b01f2f7a tempest-VolumesDeleteCascade-1270060848 None] Lock "cinder-137d74d0-db0e-4142-b70d-bf658f583976-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-42afa5b9-4d49-498f-9054-cb8b9de41823-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "cinder-42afa5b9-4d49-498f-9054-cb8b9de41823-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-quobyte-42afa5b9-4d49-498f-9054-cb8b9de41823" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-42afa5b9-4d49-498f-9054-cb8b9de41823" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073af32-3f51-4adb-9906-9924dec9883a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:01 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823
Apr 09 13:35:01 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:01 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:01 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823
Apr 09 13:35:01 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-154e988a-3a1b-41f0-b527-4621555c1d7b tempest-GroupSnapshotsTest-982305852 None] Update group completed successfully.
Apr 09 13:35:02 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42afa5b9-4d49-498f-9054-cb8b9de41823" returned: 0 in 0.446s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-42afa5b9-4d49-498f-9054-cb8b9de41823" released by "delete_volume" :: held 0.972s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-090118ae-1133-45f9-b72f-eda2ad58755a req-baa560f2-2b59-4916-b01a-86c31f9992c4 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Terminate volume connection completed successfully.
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [req-090118ae-1133-45f9-b72f-eda2ad58755a req-baa560f2-2b59-4916-b01a-86c31f9992c4 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Deleting attachment a2c9dc3e-a983-49c9-ad00-b02a4a448ca1. {{(pid=82360) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Created reservations ['cfcc38dc-2676-4ec5-90e8-16b41e7b1139', 'cabb7aab-c06e-4858-b125-934cfdbd6fce', 'de90288a-0256-4a33-a54e-42c23de0404a', 'c844b986-e83c-4b91-8eba-db6fada78dc1'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:02 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:02 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:02 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.461s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Deleted volume successfully.
Apr 09 13:35:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-af4214e6-1f59-4576-acde-6fe8a120e531 tempest-VolumesActionsTest-83802475 None] Lock "cinder-42afa5b9-4d49-498f-9054-cb8b9de41823-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "cinder-c16740eb-201b-49a6-b6d0-2133909d123d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-c16740eb-201b-49a6-b6d0-2133909d123d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "cinder-quobyte-c16740eb-201b-49a6-b6d0-2133909d123d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-quobyte-c16740eb-201b-49a6-b6d0-2133909d123d" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccf5792-c944-4c4c-88f7-5d0271c413e3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:03 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d609756d-0a3e-4efc-b2dc-76eb7514da47 tempest-GroupSnapshotsTest-982305852 None] Update group completed successfully.
Apr 09 13:35:03 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d
Apr 09 13:35:03 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (bc18cda1-d5da-4982-a3b1-5431a45c81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43f8df2-9c38-4b14-a1e7-976a3e65d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43f8df2-9c38-4b14-a1e7-976a3e65d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2143879477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953a1c96-f306-4c34-b590-dae966e1ccab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:04Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e560a94-e13c-4957-b6eb-eaa75457a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e560a94-e13c-4957-b6eb-eaa75457a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8dd5a6-1331-4d52-a7f3-25ed285bfa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8dd5a6-1331-4d52-a7f3-25ed285bfa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953a1c96-f306-4c34-b590-dae966e1ccab', 'volume_name': 'volume-953a1c96-f306-4c34-b590-dae966e1ccab', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d97478a-d44a-4d26-9d6b-874caeadfd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d97478a-d44a-4d26-9d6b-874caeadfd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb8c30e-6cc0-4ef4-82a4-b503bfaa3be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:03 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Volume 953a1c96-f306-4c34-b590-dae966e1ccab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953a1c96-f306-4c34-b590-dae966e1ccab', 'volume_size': 1}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2143879477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953a1c96-f306-4c34-b590-dae966e1ccab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:04Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Creating volume 953a1c96-f306-4c34-b590-dae966e1ccab {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:03 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:03 devstack sudo[86598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab 1073741824
Apr 09 13:35:03 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:03 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d" returned: 0 in 0.677s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:03 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d
Apr 09 13:35:03 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:04 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c16740eb-201b-49a6-b6d0-2133909d123d" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-quobyte-c16740eb-201b-49a6-b6d0-2133909d123d" released by "delete_volume" :: held 1.196s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:04 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab 1073741824" returned: 0 in 0.570s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.quota [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Created reservations ['dd6710d2-e70d-487d-bbe5-5ba3ce581e85', '7f3c7b82-9bc6-431f-ab9a-71aa6b8d17b6', '67ba4e7b-48b7-464f-b2a1-e457c3b559c2', 'a05438c1-2c50-4946-bbc7-440de8387881'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:04 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-11e2714f-4688-4c64-80b8-92555f1ddd11 tempest-GroupSnapshotsTest-982305852 None] Update group completed successfully.
Apr 09 13:35:04 devstack sudo[86607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:04 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:04 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab
Apr 09 13:35:04 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Flow 'volume_create_manager' (e560c618-2b93-4f95-a0fd-b40abcdf09f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65ed163-9e82-48ba-8704-37079581fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65ed163-9e82-48ba-8704-37079581fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1401478564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ea8626-db7d-48b8-9696-0c5fb3bdc64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566121860ac1408daed0e32d2eca860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:05Z,use_quota=True,user_id='756d4d7958fe4c298859569b630a22b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03c1b4a-93cc-4d48-be96-dbeb68f28f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03c1b4a-93cc-4d48-be96-dbeb68f28f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d83408-1453-4c8f-a905-0d4a0d06ff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d83408-1453-4c8f-a905-0d4a0d06ff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ea8626-db7d-48b8-9696-0c5fb3bdc64a', 'volume_name': 'volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756b565-7c83-4225-998c-ef16c5d6a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756b565-7c83-4225-998c-ef16c5d6a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4bfa05-2926-4827-9dad-bc6e64bad00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Volume e7ea8626-db7d-48b8-9696-0c5fb3bdc64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a', 'volume_size': 1}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:04 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab" returned: 0 in 0.451s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.247s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1401478564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ea8626-db7d-48b8-9696-0c5fb3bdc64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566121860ac1408daed0e32d2eca860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:05Z,use_quota=True,user_id='756d4d7958fe4c298859569b630a22b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Creating volume e7ea8626-db7d-48b8-9696-0c5fb3bdc64a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:04 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:04 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.500s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.manager [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:04 devstack cinder-volume[82360]: INFO cinder.volume.manager [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Deleted volume successfully.
Apr 09 13:35:04 devstack sudo[86613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a 1073741824
Apr 09 13:35:04 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb8c30e-6cc0-4ef4-82a4-b503bfaa3be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953a1c96-f306-4c34-b590-dae966e1ccab', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a6f064-7d13-48de-8dcc-d5adc35763f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [req-090118ae-1133-45f9-b72f-eda2ad58755a req-26436089-a230-419c-8f50-720d1e1e24b5 tempest-ServerBootFromVolumeStableRescueTest-105565284 None] Lock "cinder-c16740eb-201b-49a6-b6d0-2133909d123d-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:04 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Volume volume-953a1c96-f306-4c34-b590-dae966e1ccab (953a1c96-f306-4c34-b590-dae966e1ccab): created successfully
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a6f064-7d13-48de-8dcc-d5adc35763f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (bc18cda1-d5da-4982-a3b1-5431a45c81fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-66b4676d-2821-4b1c-aae8-f9cad06fd04b tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:05 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:05 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:05 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a 1073741824" returned: 0 in 0.549s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:05 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a
Apr 09 13:35:05 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:05 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] GroupSnapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: creating.
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Group snapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: creating. {{(pid=82360) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-953a1c96-f306-4c34-b590-dae966e1ccab-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "cinder-953a1c96-f306-4c34-b590-dae966e1ccab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:06 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.288s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4bfa05-2926-4827-9dad-bc6e64bad00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15672d57-31a6-4c82-94c0-d4ec9a1583f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:06 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Volume volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a (e7ea8626-db7d-48b8-9696-0c5fb3bdc64a): created successfully
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15672d57-31a6-4c82-94c0-d4ec9a1583f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Flow 'volume_create_manager' (e560c618-2b93-4f95-a0fd-b40abcdf09f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Creating offline snapshot 60b53709-8759-4384-b5bb-c7c1c30dd563 of volume fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:35:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9293b851-9ef4-4c35-9870-4726aee1d3b7 tempest-VolumesTransfersV357Test-1914411177 None] Created volume successfully.
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e817499-530a-4292-aa7c-308f8b4cfb6c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Acquiring lock "cinder-quobyte-953a1c96-f306-4c34-b590-dae966e1ccab" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-953a1c96-f306-4c34-b590-dae966e1ccab" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[80efdeef-3028-4c27-8a13-3a2ce2da569d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:06 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940
Apr 09 13:35:06 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:06 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab
Apr 09 13:35:06 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:06 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940" returned: 0 in 0.510s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:06 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 1G
Apr 09 13:35:06 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:06 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab" returned: 0 in 0.521s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:06 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab
Apr 09 13:35:06 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:07 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-953a1c96-f306-4c34-b590-dae966e1ccab" returned: 0 in 0.530s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:07 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 1G" returned: 0 in 0.605s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4a7115-502c-4347-a538-05feac2c3940 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "cinder-quobyte-953a1c96-f306-4c34-b590-dae966e1ccab" released by "delete_volume" :: held 1.103s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:07 devstack sudo[86653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4a7115-502c-4347-a538-05feac2c3940 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563
Apr 09 13:35:07 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d33a6be7-d7f1-481e-9375-b513543cd6d7 tempest-VolumesTransfersV357Test-1358534862 None] Transfer volume completed successfully.
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Created reservations ['7242d5b5-883d-4569-8f5d-b592f0a0c091', '295e9e70-9937-4966-a444-2b74e14770ec', '57397afe-3399-4df7-afa1-5493e511d93e', '2e94d08b-14b3-405a-806e-1192a3a048e0'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:07 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:07 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:07 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4a7115-502c-4347-a538-05feac2c3940 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:07 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:07 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563
Apr 09 13:35:07 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:07 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.597s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Deleted volume successfully.
Apr 09 13:35:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c6b0c3c0-b2c6-462c-acbd-15a8d05952e3 tempest-VolumesActionsTest-83802475 None] Lock "cinder-953a1c96-f306-4c34-b590-dae966e1ccab-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "cinder-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "cinder-quobyte-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-quobyte-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3140a771-4d33-4df7-b587-e112ec435a05]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:08 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a
Apr 09 13:35:08 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:08 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:08 devstack sudo[86682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info
Apr 09 13:35:08 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (aef6af0c-e0b7-414e-ad53-cf1066e1c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb370f7-4987-4902-ad5c-e8e120b3999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb370f7-4987-4902-ad5c-e8e120b3999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694488835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1980c2-be1e-4cc8-a022-13ba797b2ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:08Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d638ce-30a7-4de5-b48b-e239f9b01190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d638ce-30a7-4de5-b48b-e239f9b01190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b12813-ca38-4ec2-a10e-0435a06505aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b12813-ca38-4ec2-a10e-0435a06505aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1980c2-be1e-4cc8-a022-13ba797b2ef2', 'volume_name': 'volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad75d657-d81a-477f-9b8f-d3433c651d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad75d657-d81a-477f-9b8f-d3433c651d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aa4e8f-143e-49fc-912b-4b322959386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Volume ea1980c2-be1e-4cc8-a022-13ba797b2ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2', 'volume_size': 1}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:08 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" returned: 0 in 0.600s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:08 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a
Apr 09 13:35:08 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:08 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:08 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:08 devstack sudo[86692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info
Apr 09 13:35:08 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:09 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-quobyte-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a" released by "delete_volume" :: held 1.078s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Created reservations ['4ea47c57-3b7c-4e6d-8ea4-aeae656c1cd2', '3dac13e3-0e53-44ca-a874-0a4a9474cb3b', 'bc77e8b2-84ef-4d29-9b95-85c6a8af6d9b', '07598de3-597a-474b-b7e4-36277a6b14bf'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:09 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:09 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:09 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.info" returned: 0 in 0.446s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.297s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Creating offline snapshot ad312dc7-313a-4d36-b33b-4af3f372f2ce of volume c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fbec1b-961f-41a5-b0b2-2a3e830517ba]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:09 devstack sudo[86698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44
Apr 09 13:35:09 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:09 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Deleted volume successfully.
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5312127c-b066-4c75-a291-cb25db15c7b6 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-e7ea8626-db7d-48b8-9696-0c5fb3bdc64a-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:09 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" returned: 0 in 0.541s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:09 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce 1G
Apr 09 13:35:09 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:10 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce 1G" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:10 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce
Apr 09 13:35:10 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Flow 'volume_create_manager' (d622296d-bd7b-4fce-b50c-ce55b5342c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3ebbc-c8dd-4971-86ff-3f6b604cbd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3ebbc-c8dd-4971-86ff-3f6b604cbd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-267935373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6a721-eb78-42a1-a40a-addc41e108b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566121860ac1408daed0e32d2eca860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:10Z,use_quota=True,user_id='756d4d7958fe4c298859569b630a22b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7c65bd-79dc-4c64-a897-8bcc75804d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7c65bd-79dc-4c64-a897-8bcc75804d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828a11d2-615a-4741-9b53-6e022fd02b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828a11d2-615a-4741-9b53-6e022fd02b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca6a721-eb78-42a1-a40a-addc41e108b1', 'volume_name': 'volume-2ca6a721-eb78-42a1-a40a-addc41e108b1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc9cfa2-0ce9-4bd1-8a54-b614ed2f7604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc9cfa2-0ce9-4bd1-8a54-b614ed2f7604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcea7fa-80a7-4586-b702-587f7fe50d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Volume 2ca6a721-eb78-42a1-a40a-addc41e108b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca6a721-eb78-42a1-a40a-addc41e108b1', 'volume_size': 1}
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:10 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:10 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:10 devstack sudo[86714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce
Apr 09 13:35:10 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:11 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce" returned: 0 in 0.404s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:11 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info
Apr 09 13:35:11 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:11 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info" returned: 0 in 0.436s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:11 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:11 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info
Apr 09 13:35:11 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:12 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.info" returned: 0 in 0.411s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.541s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694488835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1980c2-be1e-4cc8-a022-13ba797b2ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3bb9200b34b17b9a54ce5d17bfef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:08Z,use_quota=True,user_id='950f64ead9bd4980a3fe632469c62836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Creating volume ea1980c2-be1e-4cc8-a022-13ba797b2ef2 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:12 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:12 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 1073741824
Apr 09 13:35:12 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f02f05d2-36e4-482e-95f7-d79807a483fb tempest-GroupSnapshotsTest-982305852 None] group_snapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: created successfully
Apr 09 13:35:12 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 1073741824" returned: 0 in 0.563s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:12 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2
Apr 09 13:35:12 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: deleting
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: deleting {{(pid=82360) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:13 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-60b53709-8759-4384-b5bb-c7c1c30dd563" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-267935373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6a721-eb78-42a1-a40a-addc41e108b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566121860ac1408daed0e32d2eca860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:10Z,use_quota=True,user_id='756d4d7958fe4c298859569b630a22b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Creating volume 2ca6a721-eb78-42a1-a40a-addc41e108b1 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:13 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:13 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 1073741824
Apr 09 13:35:13 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aa4e8f-143e-49fc-912b-4b322959386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91486a18-ff24-41ad-ac94-47c6845c4e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-60b53709-8759-4384-b5bb-c7c1c30dd563" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Deleting offline snapshot 60b53709-8759-4384-b5bb-c7c1c30dd563 of volume fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] snapshot_file for this snap is: volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:35:13 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Volume volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 (ea1980c2-be1e-4cc8-a022-13ba797b2ef2): created successfully
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91486a18-ff24-41ad-ac94-47c6845c4e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Flow 'volume_create_manager' (aef6af0c-e0b7-414e-ad53-cf1066e1c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c5b38-73f0-4875-ace9-293ae2028c10]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a481ebd1-5b6b-48a3-82c9-17309deac88a tempest-VolumesActionsTest-468022988 None] Created volume successfully.
Apr 09 13:35:13 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563
Apr 09 13:35:13 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:13 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 1073741824" returned: 0 in 0.598s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:13 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563" returned: 0 in 0.544s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4a7115-502c-4347-a538-05feac2c3940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:35:13 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1
Apr 09 13:35:13 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[189fc35f-0133-406d-96c7-4470eeecdc8b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:13 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940
Apr 09 13:35:13 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:14 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-ea1980c2-be1e-4cc8-a022-13ba797b2ef2-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcea7fa-80a7-4586-b702-587f7fe50d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca6a721-eb78-42a1-a40a-addc41e108b1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad702628-b9e3-456a-8cd1-6dcd3c0334e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:14 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Volume volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 (2ca6a721-eb78-42a1-a40a-addc41e108b1): created successfully
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad702628-b9e3-456a-8cd1-6dcd3c0334e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Flow 'volume_create_manager' (d622296d-bd7b-4fce-b50c-ce55b5342c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "cinder-ea1980c2-be1e-4cc8-a022-13ba797b2ef2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:14 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b08aee09-83e4-4962-9357-6ec613d93b28 tempest-VolumesTransfersV357Test-1914411177 None] Created volume successfully.
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Acquiring lock "cinder-quobyte-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "cinder-quobyte-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c086b-5100-4c01-a529-d05c501d7c25]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:14 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:14 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940" returned: 0 in 0.638s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:14 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:14 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563
Apr 09 13:35:14 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "cinder-2ca6a721-eb78-42a1-a40a-addc41e108b1-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-2ca6a721-eb78-42a1-a40a-addc41e108b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "cinder-quobyte-2ca6a721-eb78-42a1-a40a-addc41e108b1" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-quobyte-2ca6a721-eb78-42a1-a40a-addc41e108b1" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[225e49f2-bcd0-414f-b79e-5da1b5a022de]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" returned: 0 in 0.633s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2
Apr 09 13:35:15 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:15 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563" returned: 0 in 0.615s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1
Apr 09 13:35:15 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:15 devstack sudo[86764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563
Apr 09 13:35:15 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:15 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" returned: 0 in 0.532s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "cinder-quobyte-ea1980c2-be1e-4cc8-a022-13ba797b2ef2" released by "delete_volume" :: held 1.187s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Created reservations ['4bddad5f-7f66-49e8-9f72-4dd49b09fbe8', 'cf9f8c74-a9fe-46e9-bb88-172043817d98', 'f2bba464-69bd-46c6-a31a-dd168aa28b2a', '90f3aff0-32f1-425c-a51d-6eb611a9ea95'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:15 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940.60b53709-8759-4384-b5bb-c7c1c30dd563" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:15 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1" returned: 0 in 0.640s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-60b53709-8759-4384-b5bb-c7c1c30dd563" released by "_delete_snapshot" :: held 2.481s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:15 devstack sudo[86773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1
Apr 09 13:35:15 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" released by "delete_snapshot" :: held 2.545s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-ad312dc7-313a-4d36-b33b-4af3f372f2ce" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-ad312dc7-313a-4d36-b33b-4af3f372f2ce" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Deleting offline snapshot ad312dc7-313a-4d36-b33b-4af3f372f2ce of volume c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] snapshot_file for this snap is: volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44bd42-f104-457a-931d-74a1085b5081]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:15 devstack sudo[86776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:15 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:15 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce
Apr 09 13:35:15 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:16 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2ca6a721-eb78-42a1-a40a-addc41e108b1" returned: 0 in 0.480s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-quobyte-2ca6a721-eb78-42a1-a40a-addc41e108b1" released by "delete_volume" :: held 1.142s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Created reservations ['5b41844a-96ac-4f99-aff3-25f72323897f', '7e6d2255-444a-48b9-bbd6-9d6239b968a2', '7fbb1fcb-e6ea-49ec-8818-99f33646e233', '02133007-0b33-4c52-be58-8d96f5c50893'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:16 devstack sudo[86780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:16 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:16 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce" returned: 0 in 0.579s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc61d6d9-9f06-4ea7-8828-90319e748543]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:16 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.585s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Deleted volume successfully.
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4045b20a-c975-4323-bd8a-1f86e49b7686 tempest-VolumesActionsTest-468022988 None] Lock "cinder-ea1980c2-be1e-4cc8-a022-13ba797b2ef2-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:16 devstack sudo[86786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44
Apr 09 13:35:16 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:16 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Deleted volume successfully.
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dfffd995-7759-4932-81e1-a9dc79b29930 tempest-VolumesTransfersV357Test-249713951 None] Lock "cinder-2ca6a721-eb78-42a1-a40a-addc41e108b1-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:16 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" returned: 0 in 0.583s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:16 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce
Apr 09 13:35:16 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:17 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce" returned: 0 in 0.655s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:17 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce
Apr 09 13:35:17 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:18 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44.ad312dc7-313a-4d36-b33b-4af3f372f2ce" returned: 0 in 0.530s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-ad312dc7-313a-4d36-b33b-4af3f372f2ce" released by "_delete_snapshot" :: held 2.404s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" released by "delete_snapshot" :: held 2.420s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:18 devstack cinder-volume[82360]: WARNING cinder.quota [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-325812428 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-325812428, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:18 devstack cinder-volume[82360]: WARNING cinder.quota [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-325812428 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-325812428, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['b3c73d8e-007d-403c-a1e8-2459a970c669', '390cb42d-9a68-49c2-8c37-0bc34359a20e', '6d72a45c-a32c-4bba-a43d-942a03050e78', 'fdd7f058-3d8c-4465-acdd-8f84b64a6d68'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['16da65fb-b344-40ae-bfe7-ede2d2059bef', '422918be-d349-49c4-a64f-17e82010b010', '0751bcdc-2a32-4ddd-8d93-daec630d10a5', 'd69ca145-725f-4d82-9de7-1e4fa9413b7b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:18 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-01d28ca5-07b3-44ff-8e57-42eac08a1c92 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 658f52fd-5c3e-49b9-b6fa-2f5711c2a698: deleted successfully
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c8147-655f-4fec-a27f-8e58e87995b8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:18 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44
Apr 09 13:35:18 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:19 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" returned: 0 in 0.641s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:19 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44
Apr 09 13:35:19 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:19 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" returned: 0 in 0.573s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-c7b636f0-ad0e-46cb-ba2d-9320a2d7af44" released by "delete_volume" :: held 1.259s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" acquired by "delete_volume" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0076b0-59ba-4144-bf97-bb16e40eb0da]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:20 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940
Apr 09 13:35:20 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:20 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940" returned: 0 in 0.690s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:20 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940
Apr 09 13:35:20 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:21 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe4a7115-502c-4347-a538-05feac2c3940" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-fe4a7115-502c-4347-a538-05feac2c3940" released by "delete_volume" :: held 1.212s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Created reservations ['267e926b-7e3d-43fc-a700-6caf8bf71cc4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:21 devstack cinder-volume[82360]: WARNING cinder.quota [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-325812428 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-325812428, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Created reservations ['f072e169-8fc1-40cd-874e-6626038437cd', '6f6c5240-d94e-4624-b050-3f639889d7be', '1cf921b7-121d-49a9-8074-657b981e665a', '44d50de4-33dd-4b3b-a5b3-d87a9c6ce14f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Created reservations ['7821a489-22b6-463f-8881-0fde166fa83a', '32c44956-1796-4924-b883-3459165d89e3', '6f9c43ff-e704-4616-89de-315e831a3f2b', 'c1128cf9-875d-460b-8278-df3a1ce77e8f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:21 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:21 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:22 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.577s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:22 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2874baae-1eb3-4684-aa2e-4e424b2e377d tempest-GroupSnapshotsTest-982305852 None] Delete group completed successfully.
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7e4a40ce-403c-406d-a46a-6379f52495d2 tempest-GroupsTest-751265001 None] Group tempest-Group1-841707900: creating
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7e4a40ce-403c-406d-a46a-6379f52495d2 tempest-GroupsTest-751265001 None] Group tempest-Group1-841707900: created successfully
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7e4a40ce-403c-406d-a46a-6379f52495d2 tempest-GroupsTest-751265001 None] Create group completed successfully.
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f0eeeb7e-fc72-412b-a8c5-f2904acacc87 tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-1924032755: creating
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f0eeeb7e-fc72-412b-a8c5-f2904acacc87 tempest-GroupSnapshotsTest-982305852 None] Group tempest-GroupSnapshotsTest-Group-1924032755: created successfully
Apr 09 13:35:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f0eeeb7e-fc72-412b-a8c5-f2904acacc87 tempest-GroupSnapshotsTest-982305852 None] Create group completed successfully.
Apr 09 13:35:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-afc87de8-e31e-4b2b-a9e0-043fb0e7a7ba tempest-GroupsTest-751265001 None] Group tempest-Group2-328389255: creating
Apr 09 13:35:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-afc87de8-e31e-4b2b-a9e0-043fb0e7a7ba tempest-GroupsTest-751265001 None] Group tempest-Group2-328389255: created successfully
Apr 09 13:35:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-afc87de8-e31e-4b2b-a9e0-043fb0e7a7ba tempest-GroupsTest-751265001 None] Create group completed successfully.
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (8fa96c1a-93fc-48b1-95d9-1c3fae0850c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b1c2ca-8506-4584-8e90-422a60666276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b1c2ca-8506-4584-8e90-422a60666276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256878218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2c7084fc-636e-470a-b94e-6ba451727578,host='devstack@QuobyteHD#QuobyteHD',id=1b544b16-886f-415f-80d9-b2b239603df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:24Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78ba073c-ded8-4836-8e55-a30bc7c544b3),volume_type_id=78ba073c-ded8-4836-8e55-a30bc7c544b3)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63a2972-74c7-4166-bfc1-76a08ce97f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63a2972-74c7-4166-bfc1-76a08ce97f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d14725-6f95-4e2b-bf97-8d8f6f64a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d14725-6f95-4e2b-bf97-8d8f6f64a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b544b16-886f-415f-80d9-b2b239603df5', 'volume_name': 'volume-1b544b16-886f-415f-80d9-b2b239603df5', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2c6a10-086f-4000-8127-9407458dcc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2c6a10-086f-4000-8127-9407458dcc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd224148-07a6-44d5-ba3e-7375c65c68a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:23 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Volume 1b544b16-886f-415f-80d9-b2b239603df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b544b16-886f-415f-80d9-b2b239603df5', 'volume_size': 1}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2c7084fc-636e-470a-b94e-6ba451727578,created_at=2026-04-09T11:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256878218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2c7084fc-636e-470a-b94e-6ba451727578,host='devstack@QuobyteHD#QuobyteHD',id=1b544b16-886f-415f-80d9-b2b239603df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e4b3afb124e09b048072b16d3eeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:24Z,use_quota=True,user_id='556ad2947381457fb895399eb54238b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78ba073c-ded8-4836-8e55-a30bc7c544b3),volume_type_id=78ba073c-ded8-4836-8e55-a30bc7c544b3)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Creating volume 1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:23 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:23 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 1073741824
Apr 09 13:35:23 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:24 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 1073741824" returned: 0 in 0.620s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:24 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5
Apr 09 13:35:24 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (e3fc7893-4880-4f11-b945-8d4c404ecf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ed1269-6deb-49bd-8129-b8a2cdf7de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ed1269-6deb-49bd-8129-b8a2cdf7de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765454945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8cd83f9e-6979-49ad-9f04-a475846a6949,host='devstack@QuobyteHD#QuobyteHD',id=c5292b01-a5d5-4417-80e7-d18bf4fb370f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:25Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(082c51c4-cad9-4085-bd3a-7babf01d60d0),volume_type_id=082c51c4-cad9-4085-bd3a-7babf01d60d0)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2092fe-8c6e-4a8c-a15a-9884c066120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2092fe-8c6e-4a8c-a15a-9884c066120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e410e0-f0f4-4bf0-9b10-39c1b86c9c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e410e0-f0f4-4bf0-9b10-39c1b86c9c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5292b01-a5d5-4417-80e7-d18bf4fb370f', 'volume_name': 'volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e0d281-fe71-4f48-82e1-22ef2afaac7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e0d281-fe71-4f48-82e1-22ef2afaac7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5712f2f5-a254-499f-aae1-a16f9c6390b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:24 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Volume c5292b01-a5d5-4417-80e7-d18bf4fb370f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f', 'volume_size': 1}
Apr 09 13:35:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:25 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5" returned: 0 in 0.580s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8cd83f9e-6979-49ad-9f04-a475846a6949,created_at=2026-04-09T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765454945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8cd83f9e-6979-49ad-9f04-a475846a6949,host='devstack@QuobyteHD#QuobyteHD',id=c5292b01-a5d5-4417-80e7-d18bf4fb370f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:25Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(082c51c4-cad9-4085-bd3a-7babf01d60d0),volume_type_id=082c51c4-cad9-4085-bd3a-7babf01d60d0)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Creating volume c5292b01-a5d5-4417-80e7-d18bf4fb370f {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:25 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd224148-07a6-44d5-ba3e-7375c65c68a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b544b16-886f-415f-80d9-b2b239603df5', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68197ab2-745f-40f7-aee4-5bc822a8feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:25 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f 1073741824
Apr 09 13:35:25 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:25 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Volume volume-1b544b16-886f-415f-80d9-b2b239603df5 (1b544b16-886f-415f-80d9-b2b239603df5): created successfully
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68197ab2-745f-40f7-aee4-5bc822a8feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Flow 'volume_create_manager' (8fa96c1a-93fc-48b1-95d9-1c3fae0850c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:25 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4c8f5fca-493c-4cce-b8e2-9ca59481b751 tempest-GroupSnapshotsTest-982305852 None] Created volume successfully.
Apr 09 13:35:25 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f 1073741824" returned: 0 in 0.560s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:25 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f
Apr 09 13:35:25 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (246fb71f-14f4-44bb-a910-bd4d297aeca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c99d52-a8a9-4d7c-8a71-350c83dda0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] GroupSnapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: creating.
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c99d52-a8a9-4d7c-8a71-350c83dda0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044864467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0242ac5-5aae-469c-bcfd-153d87d63f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:26Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab34b3-efe9-4bb7-b7bb-cbb31d80ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab34b3-efe9-4bb7-b7bb-cbb31d80ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e46798-5c3d-4cf4-bb70-1b96303288cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e46798-5c3d-4cf4-bb70-1b96303288cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0242ac5-5aae-469c-bcfd-153d87d63f77', 'volume_name': 'volume-c0242ac5-5aae-469c-bcfd-153d87d63f77', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f889179-11fc-4db4-afe3-4483a023adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f889179-11fc-4db4-afe3-4483a023adcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0f9a7-580a-4046-9253-371bc9f96991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Volume c0242ac5-5aae-469c-bcfd-153d87d63f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0242ac5-5aae-469c-bcfd-153d87d63f77', 'volume_size': 1}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Group snapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: creating. {{(pid=82360) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:26 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f" returned: 0 in 0.571s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044864467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0242ac5-5aae-469c-bcfd-153d87d63f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:26Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Creating volume c0242ac5-5aae-469c-bcfd-153d87d63f77 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:26 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5712f2f5-a254-499f-aae1-a16f9c6390b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 1073741824
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95471be6-9dc8-481f-94e9-99f5f8053b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:26 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Volume volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f (c5292b01-a5d5-4417-80e7-d18bf4fb370f): created successfully
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95471be6-9dc8-481f-94e9-99f5f8053b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (e3fc7893-4880-4f11-b945-8d4c404ecf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2126c117-442b-4b31-9b45-25706353e616 tempest-GroupsTest-751265001 None] Created volume successfully.
Apr 09 13:35:26 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 1073741824" returned: 0 in 0.513s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:26 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77
Apr 09 13:35:26 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Acquiring lock "cinder-quobyte-c5292b01-a5d5-4417-80e7-d18bf4fb370f" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:27 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-c5292b01-a5d5-4417-80e7-d18bf4fb370f" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77" returned: 0 in 0.570s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9a17f1-952d-437d-8341-d44b1ef292c4]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.178s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0f9a7-580a-4046-9253-371bc9f96991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0242ac5-5aae-469c-bcfd-153d87d63f77', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c502d23e-6520-4852-966b-b187503642a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Creating offline snapshot 8b0531c8-4f77-4778-ac51-99e603a2d9ae of volume 1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:35:27 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Volume volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 (c0242ac5-5aae-469c-bcfd-153d87d63f77): created successfully
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c502d23e-6520-4852-966b-b187503642a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (246fb71f-14f4-44bb-a910-bd4d297aeca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:27 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f
Apr 09 13:35:27 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610740a-0b71-47e8-adf0-ffdbd51e7db0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-27454e25-cf91-4f82-a7ed-e90c85f627e6 tempest-VolumesListAdminTestJSON-380693750 None] Created volume successfully.
Apr 09 13:35:27 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5
Apr 09 13:35:27 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:28 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f" returned: 0 in 0.616s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:28 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:28 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f
Apr 09 13:35:28 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:28 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae 1G
Apr 09 13:35:28 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:28 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5292b01-a5d5-4417-80e7-d18bf4fb370f" returned: 0 in 0.698s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-c5292b01-a5d5-4417-80e7-d18bf4fb370f" released by "delete_volume" :: held 1.368s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:28 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (9e6089e0-6549-4ac9-b92e-54906d3f1482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a076d36-3405-451d-9bda-9b9a4bdadc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae 1G" returned: 0 in 0.781s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b544b16-886f-415f-80d9-b2b239603df5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:28 devstack sudo[86868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b544b16-886f-415f-80d9-b2b239603df5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae
Apr 09 13:35:28 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a076d36-3405-451d-9bda-9b9a4bdadc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567862071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb967b88-4976-46be-8221-1788e908835e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:29Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52ccfb3-b7ac-4e8e-b8c7-0666cddaa993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52ccfb3-b7ac-4e8e-b8c7-0666cddaa993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3569c971-a2b8-4cc9-990c-f97a04f0aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3569c971-a2b8-4cc9-990c-f97a04f0aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb967b88-4976-46be-8221-1788e908835e', 'volume_name': 'volume-cb967b88-4976-46be-8221-1788e908835e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b04ce-80c4-4d81-a437-4a5b77261eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b04ce-80c4-4d81-a437-4a5b77261eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448a075f-f85c-46e3-afcb-f1da0fc690d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:28 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Volume cb967b88-4976-46be-8221-1788e908835e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb967b88-4976-46be-8221-1788e908835e', 'volume_size': 1}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:28 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Created reservations ['bdc2e4ef-3b6c-459d-8d11-3a7e87fcbcc4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:28 devstack cinder-volume[82360]: WARNING cinder.quota [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-492249028 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-492249028, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:28 devstack cinder-volume[82360]: WARNING cinder.quota [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-492249028 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-492249028, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Created reservations ['928b58ee-8986-4ab1-b433-c932138d2159', '1553b7bd-03b3-4107-a6f8-9cf440250f21', '8bb54900-7600-4c09-9c84-e04b37304c42', 'de1aa0c4-f131-418d-bb6b-03f050dc1be3'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Flow 'volume_create_manager' (bedd037b-387d-41d7-a8a4-db3af5527a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3dc1ba-631a-408f-8a8a-0bc33cfe9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3dc1ba-631a-408f-8a8a-0bc33cfe9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197295034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c47451-2220-4f13-bd3e-01b80b37fd52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6b8893642a47ffb87862939d7078e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:29Z,use_quota=True,user_id='b0b4b70a1f0d44269c70d9739db35717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e5f22a-9ecb-46c6-86d0-9da11390ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e5f22a-9ecb-46c6-86d0-9da11390ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbefc1d-4305-4094-b6ac-acc82160a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbefc1d-4305-4094-b6ac-acc82160a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c47451-2220-4f13-bd3e-01b80b37fd52', 'volume_name': 'volume-79c47451-2220-4f13-bd3e-01b80b37fd52', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b29b2b-1423-4ab1-a486-ffa9a8f1cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b29b2b-1423-4ab1-a486-ffa9a8f1cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d6499a-c451-4c67-a75d-41922387a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:29 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Volume 79c47451-2220-4f13-bd3e-01b80b37fd52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c47451-2220-4f13-bd3e-01b80b37fd52', 'volume_size': 1}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:29 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:29 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:29 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b544b16-886f-415f-80d9-b2b239603df5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae" returned: 0 in 0.553s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:29 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:29 devstack sudo[86875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae
Apr 09 13:35:29 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:29 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.424s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:29 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-27294a45-50d8-457a-b355-dab8d0970b45 tempest-GroupsTest-751265001 None] Delete group completed successfully.
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Created reservations ['183266bf-7426-4da9-b7da-751d2a27e498'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:29 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:29 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:29 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:29 devstack sudo[86881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info
Apr 09 13:35:29 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:30 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9cabb464-d6cc-49f7-aa13-d6f55cc22ba6 tempest-GroupsTest-751265001 None] Delete group completed successfully.
Apr 09 13:35:30 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info" returned: 0 in 0.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:30 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:30 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info
Apr 09 13:35:30 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:30 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.info" returned: 0 in 0.403s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.800s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567862071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb967b88-4976-46be-8221-1788e908835e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:29Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Creating volume cb967b88-4976-46be-8221-1788e908835e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:30 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:30 devstack sudo[86888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e 1073741824
Apr 09 13:35:30 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7a9e51c7-d892-40d3-8cff-0558ce20a18e tempest-GroupSnapshotsTest-982305852 None] group_snapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: created successfully
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a049f1b4-cf64-49b1-89b8-47ddc959becb tempest-GroupsTest-751265001 None] Group tempest-GroupsTest-Group-1479299111: creating
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a049f1b4-cf64-49b1-89b8-47ddc959becb tempest-GroupsTest-751265001 None] Group tempest-GroupsTest-Group-1479299111: created successfully
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a049f1b4-cf64-49b1-89b8-47ddc959becb tempest-GroupsTest-751265001 None] Create group completed successfully.
Apr 09 13:35:31 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e 1073741824" returned: 0 in 0.539s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:31 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e
Apr 09 13:35:31 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: deleting
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: deleting {{(pid=82360) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-8b0531c8-4f77-4778-ac51-99e603a2d9ae" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-8b0531c8-4f77-4778-ac51-99e603a2d9ae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Deleting offline snapshot 8b0531c8-4f77-4778-ac51-99e603a2d9ae of volume 1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] snapshot_file for this snap is: volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[357c1a4e-ac78-4a08-bdb1-aa412d2ace04]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:31 devstack sudo[86895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae
Apr 09 13:35:31 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:31 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e" returned: 0 in 0.465s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.657s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197295034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c47451-2220-4f13-bd3e-01b80b37fd52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6b8893642a47ffb87862939d7078e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:29Z,use_quota=True,user_id='b0b4b70a1f0d44269c70d9739db35717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Creating volume 79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448a075f-f85c-46e3-afcb-f1da0fc690d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb967b88-4976-46be-8221-1788e908835e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ff4ce3-0985-464b-b9f0-84604ab3ddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:31 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 1073741824
Apr 09 13:35:31 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Volume volume-cb967b88-4976-46be-8221-1788e908835e (cb967b88-4976-46be-8221-1788e908835e): created successfully
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ff4ce3-0985-464b-b9f0-84604ab3ddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (9e6089e0-6549-4ac9-b92e-54906d3f1482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b1fb5bed-0402-4f1b-8feb-3b6a455f7d1c tempest-VolumesListAdminTestJSON-380693750 None] Created volume successfully.
Apr 09 13:35:32 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b544b16-886f-415f-80d9-b2b239603df5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8813e-86fa-4351-b1dc-fc64293f939b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:32 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5
Apr 09 13:35:32 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (f8217308-4a50-4d24-8e68-1a657df0a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885db277-0b41-493c-a4eb-20815b637562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885db277-0b41-493c-a4eb-20815b637562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620443719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9281cd6-97a7-4478-9769-c4983d1ccf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:32Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b63e0a-9712-4ce0-8d33-55652f8b34da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b63e0a-9712-4ce0-8d33-55652f8b34da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad66a7f-c85b-445d-afb1-dc04002baa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad66a7f-c85b-445d-afb1-dc04002baa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9281cd6-97a7-4478-9769-c4983d1ccf0b', 'volume_name': 'volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3776680-c299-481e-804d-365d710acdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3776680-c299-481e-804d-365d710acdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28b4ff5-6b8e-434e-b2df-5c501c0d37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Volume d9281cd6-97a7-4478-9769-c4983d1ccf0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b', 'volume_size': 1}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 1073741824" returned: 0 in 0.583s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:32 devstack sudo[86908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:35:32 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (200c4497-d87b-4202-a9c2-4aed5c3784ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5462dd84-fc64-42c1-a35d-45d4c66490e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5462dd84-fc64-42c1-a35d-45d4c66490e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2055515011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,host='devstack@QuobyteHD#QuobyteHD',id=e0b95601-08f9-4225-ab5a-3c3bf5a74834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:33Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ee36872-8387-41fb-aebc-bd55309b5130),volume_type_id=9ee36872-8387-41fb-aebc-bd55309b5130)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da7a1a7-5a99-4d1c-b6ca-84c35553e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da7a1a7-5a99-4d1c-b6ca-84c35553e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed34a7c-559b-4f56-961f-dedde4cec600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed34a7c-559b-4f56-961f-dedde4cec600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b95601-08f9-4225-ab5a-3c3bf5a74834', 'volume_name': 'volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f57db04-94cf-4012-ac79-652384e471d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f57db04-94cf-4012-ac79-652384e471d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789c5c8a-6a63-46d0-897d-8b2895ae490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Volume e0b95601-08f9-4225-ab5a-3c3bf5a74834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834', 'volume_size': 1}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:32 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:32 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae
Apr 09 13:35:32 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:32 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.467s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620443719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9281cd6-97a7-4478-9769-c4983d1ccf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c893a73439de427594a9b369b1e0a768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:32Z,use_quota=True,user_id='aa2eee300bbc410e8cba70857dcfedb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Creating volume d9281cd6-97a7-4478-9769-c4983d1ccf0b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:32 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d6499a-c451-4c67-a75d-41922387a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c47451-2220-4f13-bd3e-01b80b37fd52', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd9b2f6-8595-4dca-aedf-f5fadfef29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:32 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b 1073741824
Apr 09 13:35:32 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Volume volume-79c47451-2220-4f13-bd3e-01b80b37fd52 (79c47451-2220-4f13-bd3e-01b80b37fd52): created successfully
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd9b2f6-8595-4dca-aedf-f5fadfef29b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Flow 'volume_create_manager' (bedd037b-387d-41d7-a8a4-db3af5527a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ad07f702-46d4-4749-9f54-998a3d51cb69 tempest-VolumesActionsTest-1638994864 None] Created volume successfully.
Apr 09 13:35:33 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:33 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae
Apr 09 13:35:33 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:33 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b 1073741824" returned: 0 in 0.587s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:33 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b
Apr 09 13:35:33 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:33 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5.8b0531c8-4f77-4778-ac51-99e603a2d9ae" returned: 0 in 0.534s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-8b0531c8-4f77-4778-ac51-99e603a2d9ae" released by "_delete_snapshot" :: held 2.137s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" released by "delete_snapshot" :: held 2.165s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:33 devstack cinder-volume[82360]: WARNING cinder.quota [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-745528145 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-745528145, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:33 devstack cinder-volume[82360]: WARNING cinder.quota [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-745528145 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-745528145, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:33 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['6845ba85-9096-45a6-ba57-a2bdf10c272e', '8d50ffc7-3bea-4b6d-a17f-4cda7ae148d2', '2306d20d-cc67-4ccc-8b08-36aabce121d8', 'b856d0f1-ab60-4907-b17a-7d0bee20252d'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b84b86a4-c0a1-4920-81fc-6ebe312de991 tempest-GroupSnapshotsTest-982305852 None] group_snapshot 80a7ada6-159a-44ec-b9ad-ebbba58f4ec7: deleted successfully
Apr 09 13:35:34 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b" returned: 0 in 0.539s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,created_at=2026-04-09T11:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2055515011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,host='devstack@QuobyteHD#QuobyteHD',id=e0b95601-08f9-4225-ab5a-3c3bf5a74834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:33Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ee36872-8387-41fb-aebc-bd55309b5130),volume_type_id=9ee36872-8387-41fb-aebc-bd55309b5130)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Creating volume e0b95601-08f9-4225-ab5a-3c3bf5a74834 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:34 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28b4ff5-6b8e-434e-b2df-5c501c0d37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47976c53-a420-4e83-8e4f-9289a2c077a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:34 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 1073741824
Apr 09 13:35:34 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:34 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Volume volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b (d9281cd6-97a7-4478-9769-c4983d1ccf0b): created successfully
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47976c53-a420-4e83-8e4f-9289a2c077a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Flow 'volume_create_manager' (f8217308-4a50-4d24-8e68-1a657df0a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-02bc18db-bae1-45a0-b1b0-4e90b04c7e9d tempest-VolumesListAdminTestJSON-380693750 None] Created volume successfully.
Apr 09 13:35:34 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 1073741824" returned: 0 in 0.591s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:34 devstack sudo[86945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834
Apr 09 13:35:34 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Flow 'volume_create_manager' (736c2358-74aa-4256-bebe-e5e3d7156874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5c8b2a-4c34-4160-b44e-3b721d6bb316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5c8b2a-4c34-4160-b44e-3b721d6bb316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a648e99-6f3e-4f48-a148-e0abb5caea1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19130b5b13ce4c6980fabd1c91f92922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:35Z,use_quota=True,user_id='b55b082f13f8429d8c57acbf48cb07f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34210d3-2159-47fc-aa40-326a750640cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34210d3-2159-47fc-aa40-326a750640cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b22290-87c5-48bd-b431-af951660e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b22290-87c5-48bd-b431-af951660e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a648e99-6f3e-4f48-a148-e0abb5caea1b', 'volume_name': 'volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34148d17-f95d-4b10-95d1-23c7673cd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34148d17-f95d-4b10-95d1-23c7673cd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a54523c-2985-4b41-b258-ea2fe85032d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Volume 5a648e99-6f3e-4f48-a148-e0abb5caea1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b', 'volume_size': 1}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fbf1ea-7aaa-4767-94fa-bef766da3681]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:35 devstack sudo[86947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5
Apr 09 13:35:35 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:35 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834" returned: 0 in 0.602s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a648e99-6f3e-4f48-a148-e0abb5caea1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19130b5b13ce4c6980fabd1c91f92922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:35Z,use_quota=True,user_id='b55b082f13f8429d8c57acbf48cb07f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Creating volume 5a648e99-6f3e-4f48-a148-e0abb5caea1b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:35 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789c5c8a-6a63-46d0-897d-8b2895ae490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b1593-99d2-423e-a971-f17110306b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:35 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b 1073741824
Apr 09 13:35:35 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:35 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Volume volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 (e0b95601-08f9-4225-ab5a-3c3bf5a74834): created successfully
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b1593-99d2-423e-a971-f17110306b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (200c4497-d87b-4202-a9c2-4aed5c3784ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1479cbf8-7c34-473f-b883-d26c642e64f1 tempest-GroupsTest-751265001 None] Created volume successfully.
Apr 09 13:35:35 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:35 devstack sudo[86959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5
Apr 09 13:35:35 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:35 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b 1073741824" returned: 0 in 0.526s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:35 devstack sudo[86961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b
Apr 09 13:35:35 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (54331b6b-4273-488d-81cd-dc73b8688d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a4f1c-ff0e-46d8-914e-6ef76424fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a4f1c-ff0e-46d8-914e-6ef76424fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1399361403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,host='devstack@QuobyteHD#QuobyteHD',id=a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:36Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ee36872-8387-41fb-aebc-bd55309b5130),volume_type_id=9ee36872-8387-41fb-aebc-bd55309b5130)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c12ebf-b70f-4f5f-82ca-788f49162e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c12ebf-b70f-4f5f-82ca-788f49162e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd00bb-ad18-435c-b321-06d5b3d6903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd00bb-ad18-435c-b321-06d5b3d6903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a', 'volume_name': 'volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a37ad21-6910-4101-aa5e-8ffc5ff13bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a37ad21-6910-4101-aa5e-8ffc5ff13bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2502a542-59ea-4279-9a6d-8378f50b1839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Volume a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a', 'volume_size': 1}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1b544b16-886f-415f-80d9-b2b239603df5" returned: 0 in 0.537s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Lock "cinder-quobyte-1b544b16-886f-415f-80d9-b2b239603df5" released by "delete_volume" :: held 1.118s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=229,cinder:UPDATE=259,cinder:INSERT=64,cinder:DELETE=13 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['4557fab8-c48e-41bc-9423-3814da96bd09'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:36 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:36 devstack cinder-volume[82360]: WARNING cinder.quota [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-745528145 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-745528145, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,created_at=2026-04-09T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1399361403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bed10a28-559c-454c-a33e-96ffbbed2ba7,host='devstack@QuobyteHD#QuobyteHD',id=a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133b5a68f21e402fb3bdd46c7858c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:36Z,use_quota=True,user_id='4493029d44084354af86dbc7b3abfc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ee36872-8387-41fb-aebc-bd55309b5130),volume_type_id=9ee36872-8387-41fb-aebc-bd55309b5130)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Creating volume a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:36 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Created reservations ['0d17965e-d977-46bf-ab3a-264af02b6cd1', '7a34fc2e-a427-41f3-b28f-94e110c833a2', '59705447-fd14-4a7e-8f13-af49d688fa59', '9bb485b9-59d3-4e69-a0a4-867e1418327b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:36 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a 1073741824
Apr 09 13:35:36 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a54523c-2985-4b41-b258-ea2fe85032d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42c7a01-7934-4043-8286-01def3dfe4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Volume volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b (5a648e99-6f3e-4f48-a148-e0abb5caea1b): created successfully
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42c7a01-7934-4043-8286-01def3dfe4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Flow 'volume_create_manager' (736c2358-74aa-4256-bebe-e5e3d7156874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-cca79a0f-f1fb-45bd-8bb9-fb8ad8cb299d tempest-VolumesListAdminTestJSON-1803052256 None] Created volume successfully.
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:36 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:36 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:36 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a 1073741824" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:36 devstack sudo[86973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a
Apr 09 13:35:36 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:36 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:36 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-bb8305b6-6bb7-427e-bb9b-04815e5a2f10 tempest-GroupSnapshotsTest-982305852 None] Delete group completed successfully.
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Acquiring lock "cinder-5a648e99-6f3e-4f48-a148-e0abb5caea1b-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "cinder-5a648e99-6f3e-4f48-a148-e0abb5caea1b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=226,cinder:UPDATE=263,cinder:DELETE=20,cinder:INSERT=53 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Acquiring lock "cinder-quobyte-5a648e99-6f3e-4f48-a148-e0abb5caea1b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "cinder-quobyte-5a648e99-6f3e-4f48-a148-e0abb5caea1b" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[baea14bc-c25a-483f-80a7-6c402de97ee9]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:37 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2502a542-59ea-4279-9a6d-8378f50b1839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dce531-069a-4699-b48b-e8145d3763c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-d9281cd6-97a7-4478-9769-c4983d1ccf0b-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:37 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b
Apr 09 13:35:37 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:37 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Volume volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a (a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a): created successfully
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dce531-069a-4699-b48b-e8145d3763c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Flow 'volume_create_manager' (54331b6b-4273-488d-81cd-dc73b8688d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-d9281cd6-97a7-4478-9769-c4983d1ccf0b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-85887c0e-8f85-4027-9575-0892cbffceb8 tempest-GroupsTest-751265001 None] Created volume successfully.
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-quobyte-d9281cd6-97a7-4478-9769-c4983d1ccf0b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-d9281cd6-97a7-4478-9769-c4983d1ccf0b" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b246ba-cfc2-4b99-bbc5-8839b1b1d42e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:37 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b
Apr 09 13:35:37 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:37 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b" returned: 0 in 0.568s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:37 devstack sudo[86983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b
Apr 09 13:35:37 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:37 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b" returned: 0 in 0.512s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:37 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b
Apr 09 13:35:37 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:38 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-5a648e99-6f3e-4f48-a148-e0abb5caea1b" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "cinder-quobyte-5a648e99-6f3e-4f48-a148-e0abb5caea1b" released by "delete_volume" :: held 1.159s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:38 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d9281cd6-97a7-4478-9769-c4983d1ccf0b" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Created reservations ['af544f94-90f1-43cd-b2a0-b521fa852e8d', '83d3cb28-caaf-4b51-b1b8-f70ecfde9395', '201711a9-2555-402f-b78a-61a7ad3bbe1a', '8988264c-fba7-40b3-b29c-bc430483540b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-d9281cd6-97a7-4478-9769-c4983d1ccf0b" released by "delete_volume" :: held 1.116s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:38 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-af94aa83-36c0-4936-b2df-bc0ecc761bdb tempest-GroupsTest-751265001 None] Update group completed successfully.
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Created reservations ['d7c94a6a-079c-45bc-a338-f19a0ea4bf04', '0e9afedd-dfdb-4080-a13b-bc9205028c2e', 'dca60aaa-ad63-440d-bd77-f31d2c9e3ed1', '9284fd85-2ad5-4578-ae4d-255310e5788c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:38 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:38 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:38 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:38 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:39 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.614s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Deleted volume successfully.
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-18134237-d63f-46d6-bcec-83d6a2fe7908 tempest-VolumesListAdminTestJSON-1803052256 None] Lock "cinder-5a648e99-6f3e-4f48-a148-e0abb5caea1b-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:39 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.573s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Deleted volume successfully.
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e9a6329d-38a8-4a05-aa55-7e6c77dd68f8 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-d9281cd6-97a7-4478-9769-c4983d1ccf0b-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-cb967b88-4976-46be-8221-1788e908835e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-cb967b88-4976-46be-8221-1788e908835e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-quobyte-cb967b88-4976-46be-8221-1788e908835e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-cb967b88-4976-46be-8221-1788e908835e" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de880f3-11d6-409d-8ed9-fffcca2cb13b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e48a7d38-41b1-4cd2-badf-0a0cf7c7f4de tempest-GroupsTest-751265001 None] Update group completed successfully.
Apr 09 13:35:39 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e
Apr 09 13:35:39 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:40 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e" returned: 0 in 0.657s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:40 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e
Apr 09 13:35:40 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:40 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-cb967b88-4976-46be-8221-1788e908835e" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-cb967b88-4976-46be-8221-1788e908835e" released by "delete_volume" :: held 1.193s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Created reservations ['e5636ea3-8049-4d8b-8c42-f38d5a2688f2', 'dd9f745d-70a7-4b84-a74e-0b1f2b10e3a0', '2234757f-78e3-42be-ba03-555aa9d87547', 'c555c7d1-3678-4935-88df-84dc5f3f183c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:40 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:40 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-583113a9-b0d6-4ddc-a8c8-a67c364217b2 tempest-GroupSnapshotsV319Test-461294095 None] Group tempest-GroupSnapshotsV319Test-Group-1030237134: creating
Apr 09 13:35:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-583113a9-b0d6-4ddc-a8c8-a67c364217b2 tempest-GroupSnapshotsV319Test-461294095 None] Group tempest-GroupSnapshotsV319Test-Group-1030237134: created successfully
Apr 09 13:35:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-583113a9-b0d6-4ddc-a8c8-a67c364217b2 tempest-GroupSnapshotsV319Test-461294095 None] Create group completed successfully.
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Acquiring lock "cinder-quobyte-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40912d9-1812-4abf-a89f-9cea82b3b67b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:41 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a
Apr 09 13:35:41 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:41 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.476s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Deleted volume successfully.
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6dc0668b-4d74-4087-a286-3b9958242de2 tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-cb967b88-4976-46be-8221-1788e908835e-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:41 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" returned: 0 in 0.513s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:41 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a
Apr 09 13:35:41 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-c0242ac5-5aae-469c-bcfd-153d87d63f77-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-c0242ac5-5aae-469c-bcfd-153d87d63f77-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "cinder-quobyte-c0242ac5-5aae-469c-bcfd-153d87d63f77" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-c0242ac5-5aae-469c-bcfd-153d87d63f77" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4db9d-9731-45e0-828a-4fb6c03d23a2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:41 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77
Apr 09 13:35:41 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:42 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" returned: 0 in 0.515s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-a6ae4ff0-5b2a-40ac-97c1-1141b2f5b21a" released by "delete_volume" :: held 1.052s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Acquiring lock "cinder-quobyte-e0b95601-08f9-4225-ab5a-3c3bf5a74834" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-e0b95601-08f9-4225-ab5a-3c3bf5a74834" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e367aac-c6f8-4fa3-8163-07eefca24538]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:42 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834
Apr 09 13:35:42 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Flow 'volume_create_manager' (fbbeb824-88fe-4c8d-927a-913c6b297093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e7076-c4cf-4a71-b7a3-a2ab25e0f5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e7076-c4cf-4a71-b7a3-a2ab25e0f5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1804304850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=433b35b3-4768-46a8-8e1c-96821c737005,host='devstack@QuobyteHD#QuobyteHD',id=dd51275a-0e0f-4196-b9c2-ae819e18462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3538c682cc4b9cae18651d6098d5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:42Z,use_quota=True,user_id='89194abcda7449e39676d188b35d9845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e13decda-669e-4f04-9af4-60784596369a),volume_type_id=e13decda-669e-4f04-9af4-60784596369a)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9229c73-c6ec-48d4-9880-9ede8dae954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9229c73-c6ec-48d4-9880-9ede8dae954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5935a7d0-b517-40c5-85ed-5d40d832d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5935a7d0-b517-40c5-85ed-5d40d832d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd51275a-0e0f-4196-b9c2-ae819e18462e', 'volume_name': 'volume-dd51275a-0e0f-4196-b9c2-ae819e18462e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:42 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d835775d-a5cf-4272-b6b8-242bfa605f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d835775d-a5cf-4272-b6b8-242bfa605f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d23314d-d5dd-4df5-9f3b-7a69a18a103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:42 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Volume dd51275a-0e0f-4196-b9c2-ae819e18462e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd51275a-0e0f-4196-b9c2-ae819e18462e', 'volume_size': 1}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=433b35b3-4768-46a8-8e1c-96821c737005,created_at=2026-04-09T11:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1804304850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=433b35b3-4768-46a8-8e1c-96821c737005,host='devstack@QuobyteHD#QuobyteHD',id=dd51275a-0e0f-4196-b9c2-ae819e18462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3538c682cc4b9cae18651d6098d5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:42Z,use_quota=True,user_id='89194abcda7449e39676d188b35d9845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e13decda-669e-4f04-9af4-60784596369a),volume_type_id=e13decda-669e-4f04-9af4-60784596369a)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Creating volume dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:42 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77" returned: 0 in 0.643s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:42 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e 1073741824
Apr 09 13:35:42 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:42 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77
Apr 09 13:35:42 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:42 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:42 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834
Apr 09 13:35:42 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:43 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c0242ac5-5aae-469c-bcfd-153d87d63f77" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-quobyte-c0242ac5-5aae-469c-bcfd-153d87d63f77" released by "delete_volume" :: held 1.139s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Created reservations ['70bc1ddc-6e1e-4c66-9144-9ef1868c5202', '61e6a0e5-4fd4-4a4d-b33b-2b6c021d3f2e', 'ba19cdfd-35ef-4288-87bd-b9aab44464a2', '147753f6-06ef-4909-9885-1d2f61857003'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:43 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e 1073741824" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:43 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e
Apr 09 13:35:43 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:43 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:43 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:43 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e0b95601-08f9-4225-ab5a-3c3bf5a74834" returned: 0 in 0.442s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "cinder-quobyte-e0b95601-08f9-4225-ab5a-3c3bf5a74834" released by "delete_volume" :: held 1.018s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Created reservations ['6d0adac7-71b8-4fc0-8d84-f123adafd4fa'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:43 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-31531777 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-31531777, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:43 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-31531777 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-31531777, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Created reservations ['b05624f3-77f8-46c2-ba6c-867f0ab7af66', '40143c83-2a75-4cdf-bf4a-e53add23b490', 'a34425bf-dd02-4dad-981d-a8e94b1222e9', 'aa0d8617-3da8-4274-9d9b-85333df42fc1'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Created reservations ['44bd88e2-ccb9-416a-b0b7-1203addc9c3d', '89d453e0-a669-4ef6-8608-5c99c287c392', '0dfff8da-2754-4785-8d6d-73344a1c921b', '8cabbc6c-fdda-478f-b7c3-5201800019ce'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:43 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e" returned: 0 in 0.496s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:43 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:43 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Deleted volume successfully.
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d23314d-d5dd-4df5-9f3b-7a69a18a103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd51275a-0e0f-4196-b9c2-ae819e18462e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1168a61-6491-4d7e-9009-702f3a357b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:43 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Volume volume-dd51275a-0e0f-4196-b9c2-ae819e18462e (dd51275a-0e0f-4196-b9c2-ae819e18462e): created successfully
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1168a61-6491-4d7e-9009-702f3a357b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Flow 'volume_create_manager' (fbbeb824-88fe-4c8d-927a-913c6b297093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6ad1a74e-9501-4e61-8503-543707b571dd tempest-VolumesListAdminTestJSON-380693750 None] Lock "cinder-c0242ac5-5aae-469c-bcfd-153d87d63f77-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:43 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-821599ed-cf1f-41ee-8459-a332e8d12db7 tempest-GroupSnapshotsV319Test-461294095 None] Created volume successfully.
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:43 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:43 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:44 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.399s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:44 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:44 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4c2e8e7d-595c-40ea-9b1b-e288420e326d tempest-GroupsTest-751265001 None] Delete group completed successfully.
Apr 09 13:35:44 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] GroupSnapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: creating.
Apr 09 13:35:44 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Group snapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: creating. {{(pid=82360) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 13:35:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Creating offline snapshot 77ab4eab-71b6-485e-ba32-9d3645bc6a50 of volume dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:35:45 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e9fff4-1903-4465-92ec-a4ea8619da8b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:45 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e
Apr 09 13:35:45 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:45 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e" returned: 0 in 0.877s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:45 devstack sudo[87133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 1G
Apr 09 13:35:45 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:46 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 1G" returned: 0 in 0.792s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51275a-0e0f-4196-b9c2-ae819e18462e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:46 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51275a-0e0f-4196-b9c2-ae819e18462e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50
Apr 09 13:35:46 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:47 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51275a-0e0f-4196-b9c2-ae819e18462e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50" returned: 0 in 0.676s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:47 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:47 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50
Apr 09 13:35:47 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7aacd8ed-f44a-40ac-9c09-86736dd936a5 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" by "attach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7aacd8ed-f44a-40ac-9c09-86736dd936a5 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" acquired by "attach_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7aacd8ed-f44a-40ac-9c09-86736dd936a5 tempest-VolumesActionsTest-1638994864 None] Attaching volume 79c47451-2220-4f13-bd3e-01b80b37fd52 to instance 5943f581-35dd-4358-a471-9e88f42b6404 at mountpoint /dev/vdb on host None.
Apr 09 13:35:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7aacd8ed-f44a-40ac-9c09-86736dd936a5 tempest-VolumesActionsTest-1638994864 None] Attach volume completed successfully.
Apr 09 13:35:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7aacd8ed-f44a-40ac-9c09-86736dd936a5 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" released by "attach_volume" :: held 0.071s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:48 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50" returned: 0 in 0.679s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:48 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info
Apr 09 13:35:48 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-70d4adb0-7b24-4147-b1e6-dae8e322be84 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" by "detach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-70d4adb0-7b24-4147-b1e6-dae8e322be84 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-70d4adb0-7b24-4147-b1e6-dae8e322be84 tempest-VolumesActionsTest-1638994864 None] Detaching volume 79c47451-2220-4f13-bd3e-01b80b37fd52 from instance 5943f581-35dd-4358-a471-9e88f42b6404.
Apr 09 13:35:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-70d4adb0-7b24-4147-b1e6-dae8e322be84 tempest-VolumesActionsTest-1638994864 None] Detach volume completed successfully.
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-70d4adb0-7b24-4147-b1e6-dae8e322be84 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:48 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info" returned: 0 in 0.682s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:48 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:35:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:48 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info
Apr 09 13:35:48 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5c2cda84-dd3d-4cd1-ab85-632c1c1d64bd tempest-GroupsV320Test-677155433 None] Group tempest-GroupsV320Test-Group-1251078374: creating
Apr 09 13:35:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5c2cda84-dd3d-4cd1-ab85-632c1c1d64bd tempest-GroupsV320Test-677155433 None] Group tempest-GroupsV320Test-Group-1251078374: created successfully
Apr 09 13:35:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5c2cda84-dd3d-4cd1-ab85-632c1c1d64bd tempest-GroupsV320Test-677155433 None] Create group completed successfully.
Apr 09 13:35:49 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.info" returned: 0 in 0.748s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a8fafafd-5001-4c55-828c-ea2889d23fe0 tempest-GroupSnapshotsV319Test-461294095 None] group_snapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: created successfully
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Flow 'volume_create_manager' (58e4cfc4-9e6c-424d-a368-114fe3aa273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eba7cd-54a8-473b-b77e-d671b71c3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eba7cd-54a8-473b-b77e-d671b71c3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1081925475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6756d80e1c8a4b169ab6a7ddaaa499a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:50Z,use_quota=True,user_id='522b907c5a6b4dfb9f4cfde8cc98cb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5ea51-a425-423b-af76-81a8571d3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5ea51-a425-423b-af76-81a8571d3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef946c-d20f-4b23-abbd-db1a397cc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.image.glance [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Creating Keystone auth plugin from conf {{(pid=82360) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef946c-d20f-4b23-abbd-db1a397cc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc', 'volume_name': 'volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3a82ec0>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5af383-a29e-4692-bdb8-6a9232aaeee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5af383-a29e-4692-bdb8-6a9232aaeee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfc46cf-a1c1-4172-a090-fa5069360303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:50 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3a82ec0>}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Trying to clone e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc from image eee3377f-d552-4152-8887-ebf4bcaa9490 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]). {{(pid=82360) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 13:35:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] group_snapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: deleting
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] group_snapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: deleting {{(pid=82360) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 13:35:50 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "cinder-quobyte-77ab4eab-71b6-485e-ba32-9d3645bc6a50" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed64a05-e5e5-4fc8-9f9a-0ad50684803f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-77ab4eab-71b6-485e-ba32-9d3645bc6a50" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Deleting offline snapshot 77ab4eab-71b6-485e-ba32-9d3645bc6a50 of volume dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] snapshot_file for this snap is: volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b2695-513f-4dd5-91b1-a47e1632c660]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:50 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD
Apr 09 13:35:50 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:51 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50
Apr 09 13:35:51 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Created reservations ['db6c4382-cb10-4897-aa59-0b0a4c5b0967'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:51 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:51 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:51 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 is fetched for user 522b907c5a6b4dfb9f4cfde8cc98cb42. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3836d76-25ae-4e4a-9011-e2272e58a441]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:51 devstack sudo[87198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD
Apr 09 13:35:51 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:51 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50" returned: 0 in 0.591s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd51275a-0e0f-4196-b9c2-ae819e18462e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7132fd-6ca0-44d1-a6c2-69f032e9a36a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:51 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e
Apr 09 13:35:51 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:51 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:51 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8c1a9969-3f6d-43dc-8acb-307cb534ef74 tempest-GroupsV320Test-677155433 None] Delete group completed successfully.
Apr 09 13:35:51 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1081925475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6756d80e1c8a4b169ab6a7ddaaa499a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:50Z,use_quota=True,user_id='522b907c5a6b4dfb9f4cfde8cc98cb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Creating volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:51 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:52 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1073741824
Apr 09 13:35:52 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:52 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e" returned: 0 in 0.574s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:52 devstack sudo[87212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50
Apr 09 13:35:52 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:52 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1073741824" returned: 0 in 0.658s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:52 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:52 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:52 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50" returned: 0 in 0.673s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:52 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50
Apr 09 13:35:52 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:53 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e.77ab4eab-71b6-485e-ba32-9d3645bc6a50" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:53 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-77ab4eab-71b6-485e-ba32-9d3645bc6a50" released by "_delete_snapshot" :: held 2.396s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 0 in 0.609s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" released by "delete_snapshot" :: held 2.443s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Attempting download of eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad49bc-d7a8-4317-a370-cb7ac13f2ba0]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:53 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1128911618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1128911618, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:53 devstack cinder-volume[82360]: WARNING cinder.quota [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1128911618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1128911618, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] Created reservations ['be155179-2f04-4678-933e-7ad3ec276a24', 'c6d6b022-165e-43f3-8c7a-669e48f23f59', '93733f18-2d3f-4837-bdd1-36a5f267e54d', 'c9496e7f-c41e-4827-b3db-c3b1e7a7e698'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:53 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh
Apr 09 13:35:53 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4611de63-b467-44ef-a57b-ef9cf62a1f24 tempest-GroupSnapshotsV319Test-461294095 None] group_snapshot 58428375-970b-4c94-aff4-66c8ddf1d77d: deleted successfully
Apr 09 13:35:53 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:53 devstack sudo[87230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh
Apr 09 13:35:53 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8937c9fe-3e73-4f18-b200-a5e2cac3b338]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:54 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh" returned: 1 in 0.629s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_rr5i78oh' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[62256f92-b3a7-4c19-8905-2adff93b993d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:54 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e
Apr 09 13:35:54 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:54 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD
Apr 09 13:35:54 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:55 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:55 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e
Apr 09 13:35:55 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:55 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] eee3377f-d552-4152-8887-ebf4bcaa9490 was qcow2, converting to raw {{(pid=82360) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:55 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:55 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:55 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd51275a-0e0f-4196-b9c2-ae819e18462e" returned: 0 in 0.561s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Lock "cinder-quobyte-dd51275a-0e0f-4196-b9c2-ae819e18462e" released by "delete_volume" :: held 1.151s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Created reservations ['16363626-c995-4b45-b17c-b41dc2a09a56'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:55 devstack cinder-volume[82360]: WARNING cinder.quota [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1128911618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1128911618, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Created reservations ['d43cb5ac-d68d-4b51-b341-0d6f52a40f66', '49891770-0dba-4c15-baa4-e5c0774c798d', 'd449449b-5dc5-4c98-9b3a-acf8a6bb9296', 'c81d0d83-baa3-4a5b-8ff2-a054b604d369'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:55 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:35:55 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Flow 'volume_create_manager' (a2b491ff-4d9c-48c5-ba66-cc725e782f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd220587-ee26-48a9-a2a2-9dc845636fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd220587-ee26-48a9-a2a2-9dc845636fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2040384798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b875ee6-920e-49f7-8c92-5c533a320d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f00fb64e9a4acfaedc537585692ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:56Z,use_quota=True,user_id='8a94405d21d54579b4615768169c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf9eb11-20e8-4c5f-b434-af0937d56524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf9eb11-20e8-4c5f-b434-af0937d56524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba08b215-f131-4aa5-84d2-5d47795860ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba08b215-f131-4aa5-84d2-5d47795860ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b875ee6-920e-49f7-8c92-5c533a320d84', 'volume_name': 'volume-2b875ee6-920e-49f7-8c92-5c533a320d84', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a983aee1-d139-4342-bcf0-125a599da4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a983aee1-d139-4342-bcf0-125a599da4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6700c30-cea1-4480-878d-fcbe3567508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:56 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Volume 2b875ee6-920e-49f7-8c92-5c533a320d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b875ee6-920e-49f7-8c92-5c533a320d84', 'volume_size': 1}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2040384798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b875ee6-920e-49f7-8c92-5c533a320d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f00fb64e9a4acfaedc537585692ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:56Z,use_quota=True,user_id='8a94405d21d54579b4615768169c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Creating volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:35:56 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:56 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 1073741824
Apr 09 13:35:56 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:56 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 0 in 1.113s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_8upauefldevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:35:56 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Converted 112.00 MB image at 100.55 MB/s
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:56 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1G
Apr 09 13:35:56 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:56 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.560s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:35:56 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a82a7473-d410-4ad6-a1d5-54793c694e8f tempest-GroupSnapshotsV319Test-461294095 None] Delete group completed successfully.
Apr 09 13:35:56 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 1073741824" returned: 0 in 0.615s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:56 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc 1G" returned: 0 in 0.565s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:56 devstack sudo[87278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84
Apr 09 13:35:56 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636fb09-956f-4524-ae48-2f02aee1b8bb]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:56 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:56 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:57 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6700c30-cea1-4480-878d-fcbe3567508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b875ee6-920e-49f7-8c92-5c533a320d84', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0b736-aa2f-4c03-9c7a-638bc1d69b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Volume volume-2b875ee6-920e-49f7-8c92-5c533a320d84 (2b875ee6-920e-49f7-8c92-5c533a320d84): created successfully
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0b736-aa2f-4c03-9c7a-638bc1d69b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Flow 'volume_create_manager' (a2b491ff-4d9c-48c5-ba66-cc725e782f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1675b067-5c4f-48ea-b88b-60271d9eaf9d tempest-SnapshotsActionsTest-1260592481 None] Created volume successfully.
Apr 09 13:35:57 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 0 in 0.651s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:57 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:57 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:58 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 1 in 0.549s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Downloaded image eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc successfully. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 for user 522b907c5a6b4dfb9f4cfde8cc98cb42 is deleted. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Marking volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc as bootable. {{(pid=82360) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Copying metadata from image eee3377f-d552-4152-8887-ebf4bcaa9490 to e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc. {{(pid=82360) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Creating volume glance metadata for volume e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc backed by image eee3377f-d552-4152-8887-ebf4bcaa9490 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82360) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfc46cf-a1c1-4172-a090-fa5069360303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3a82ec0>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d7d05c-8344-4ad5-ad7e-0f45da661bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:35:58 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Volume volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc (e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc): created successfully
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d7d05c-8344-4ad5-ad7e-0f45da661bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Flow 'volume_create_manager' (58e4cfc4-9e6c-424d-a368-114fe3aa273c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:35:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2adf1af2-b0d3-4bc6-8a72-73c0df89ef0a tempest-VolumesImageMetadata-49867986 None] Created volume successfully.
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Creating offline snapshot 6ce22e7d-cb41-4d06-873b-4367d0623df0 of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39e449-99d0-4c72-89c8-39341dfc56c5]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:58 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84
Apr 09 13:35:58 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Acquiring lock "cinder-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "cinder-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Acquiring lock "cinder-quobyte-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "cinder-quobyte-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:35:59 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84" returned: 0 in 0.664s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee0b417-f402-4de6-aac9-42234e9a58ee]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:59 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 1G
Apr 09 13:35:59 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:59 devstack sudo[87300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:59 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:59 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 1G" returned: 0 in 0.567s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:59 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:35:59 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:35:59 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 0 in 0.625s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:35:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:35:59 devstack sudo[87310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:35:59 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-574bc142-c150-48b9-964d-9640b22782ef tempest-GroupsV314Test-1995630840 None] Group tempest-GroupsV314Test-Group-946030564: creating
Apr 09 13:36:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-574bc142-c150-48b9-964d-9640b22782ef tempest-GroupsV314Test-1995630840 None] Group tempest-GroupsV314Test-Group-946030564: created successfully
Apr 09 13:36:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-574bc142-c150-48b9-964d-9640b22782ef tempest-GroupsV314Test-1995630840 None] Create group completed successfully.
Apr 09 13:36:00 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:00 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 is being set with open permissions: ugo+rw
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:00 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:00 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:00 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 1 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:00 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc
Apr 09 13:36:00 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:00 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:00 devstack sudo[87323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info
Apr 09 13:36:00 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:00 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "cinder-quobyte-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc" released by "delete_volume" :: held 1.716s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Created reservations ['a15c92e6-2872-41d1-b771-31538a643781', 'c7bbff8c-134a-41cb-884e-63a922ad9861', '09784684-9b08-4a06-a436-6c39440b7c07', 'a864e4e5-41f4-4b90-9da9-25884449f9dd'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:00 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:00 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:01 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:01 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info is being set with open permissions: ugo+rw
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:01 devstack sudo[87329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info
Apr 09 13:36:01 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:01 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Deleted volume successfully.
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-420cc4d8-9d38-483b-b9e6-892640456ac8 tempest-VolumesImageMetadata-49867986 None] Lock "cinder-e75f8242-6e4e-4ebc-b7fa-1bb76573f0fc-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Flow 'volume_create_manager' (5dfe6415-adc8-4b8e-9d70-8b5e81cee6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86444300-a272-4b81-aaf2-db6aff841713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86444300-a272-4b81-aaf2-db6aff841713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-239776079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5f111a2-2e81-46c1-909c-4e07fafb8251,host='devstack@QuobyteHD#QuobyteHD',id=d5ffcafa-89a3-4d00-884c-5a685c016645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c813a9de65485ebd07943f7f1cf07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:02Z,use_quota=True,user_id='6712cc652f3448f4ac37cca700a78b98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94a523a5-c0ad-4b7b-9529-43c96057d056),volume_type_id=94a523a5-c0ad-4b7b-9529-43c96057d056)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df4ece3-35dc-4598-8b13-205684d08cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df4ece3-35dc-4598-8b13-205684d08cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476cd41c-7492-47d9-b2f6-c850efdaf3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:01 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476cd41c-7492-47d9-b2f6-c850efdaf3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ffcafa-89a3-4d00-884c-5a685c016645', 'volume_name': 'volume-d5ffcafa-89a3-4d00-884c-5a685c016645', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20970121-1002-4235-a506-67a5f05a897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20970121-1002-4235-a506-67a5f05a897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c17cb-2e50-4479-b50e-8b5808e5f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:01 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Volume d5ffcafa-89a3-4d00-884c-5a685c016645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ffcafa-89a3-4d00-884c-5a685c016645', 'volume_size': 1}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.info" returned: 0 in 0.642s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.358s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b5f111a2-2e81-46c1-909c-4e07fafb8251,created_at=2026-04-09T11:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-239776079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5f111a2-2e81-46c1-909c-4e07fafb8251,host='devstack@QuobyteHD#QuobyteHD',id=d5ffcafa-89a3-4d00-884c-5a685c016645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c813a9de65485ebd07943f7f1cf07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:02Z,use_quota=True,user_id='6712cc652f3448f4ac37cca700a78b98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94a523a5-c0ad-4b7b-9529-43c96057d056),volume_type_id=94a523a5-c0ad-4b7b-9529-43c96057d056)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Creating volume d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:01 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:01 devstack sudo[87333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 1073741824
Apr 09 13:36:01 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ce83dc1e-bce7-4a6f-aa94-b70f10c50dca tempest-SnapshotsActionsTest-1260592481 None] Create snapshot completed successfully
Apr 09 13:36:02 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 1073741824" returned: 0 in 0.635s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:02 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:02 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:03 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c17cb-2e50-4479-b50e-8b5808e5f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ffcafa-89a3-4d00-884c-5a685c016645', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ba0fde-ccd3-4785-ba8f-ebceb963cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:03 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Volume volume-d5ffcafa-89a3-4d00-884c-5a685c016645 (d5ffcafa-89a3-4d00-884c-5a685c016645): created successfully
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ba0fde-ccd3-4785-ba8f-ebceb963cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Flow 'volume_create_manager' (5dfe6415-adc8-4b8e-9d70-8b5e81cee6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:03 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-54cd6df4-2e19-4704-9ca9-c419bf7ea412 tempest-GroupsV314Test-1995630840 None] Created volume successfully.
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Creating offline snapshot b7143f8e-915d-4c05-8e88-58c66149e3dc of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b0106e-3171-4625-8182-2ed15b0e626c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:03 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:03 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:03 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.729s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:03 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc 1G
Apr 09 13:36:03 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Flow 'volume_create_manager' (1f486ec2-bc4c-4635-b9c8-8aa9e42b4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97427c78-e8c6-467d-8a1d-893a06374dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97427c78-e8c6-467d-8a1d-893a06374dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1805314664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0c21b-84a7-4efe-82fa-574cf409227c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a278aef08c5469fb0125ee1e2108b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:04Z,use_quota=True,user_id='7aeef1950a9b48d4916273a370e40719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e711fcd-1a89-4c43-8a1f-c118d1f76f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e711fcd-1a89-4c43-8a1f-c118d1f76f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66802f2e-f9b2-4d24-bd49-8d5d1a8ebc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66802f2e-f9b2-4d24-bd49-8d5d1a8ebc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc0c21b-84a7-4efe-82fa-574cf409227c', 'volume_name': 'volume-fdc0c21b-84a7-4efe-82fa-574cf409227c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069040b1-c011-4f05-9112-759cd302b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069040b1-c011-4f05-9112-759cd302b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94662ba3-67bd-4815-b428-55ed9575210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:04 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Volume fdc0c21b-84a7-4efe-82fa-574cf409227c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc0c21b-84a7-4efe-82fa-574cf409227c', 'volume_size': 1}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:04 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc 1G" returned: 0 in 0.595s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:04 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc
Apr 09 13:36:04 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:05 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc" returned: 0 in 0.487s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:05 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc is being set with open permissions: ugo+rw
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:05 devstack sudo[87373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc
Apr 09 13:36:05 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:05 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:05 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:05 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1805314664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0c21b-84a7-4efe-82fa-574cf409227c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a278aef08c5469fb0125ee1e2108b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:04Z,use_quota=True,user_id='7aeef1950a9b48d4916273a370e40719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Creating volume fdc0c21b-84a7-4efe-82fa-574cf409227c {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:05 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:05 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c 1073741824
Apr 09 13:36:05 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ebbcd62c-7a63-4065-a8ca-c441010430d1 tempest-SnapshotsActionsTest-1260592481 None] Create snapshot completed successfully
Apr 09 13:36:05 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:06 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c 1073741824" returned: 0 in 0.548s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:06 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c
Apr 09 13:36:06 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-b7143f8e-915d-4c05-8e88-58c66149e3dc-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-b7143f8e-915d-4c05-8e88-58c66149e3dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-b7143f8e-915d-4c05-8e88-58c66149e3dc" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-b7143f8e-915d-4c05-8e88-58c66149e3dc" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Deleting offline snapshot b7143f8e-915d-4c05-8e88-58c66149e3dc of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] snapshot_file for this snap is: volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b89bf5-e888-40a9-886c-4fa7068dcbf2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:06 devstack sudo[87389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc
Apr 09 13:36:06 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:06 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c" returned: 0 in 0.456s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.787s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:06 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Cloning volume d5ffcafa-89a3-4d00-884c-5a685c016645 to volume 010ba02f-6d92-46c6-a77e-cdd498c0a98d
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94662ba3-67bd-4815-b428-55ed9575210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc0c21b-84a7-4efe-82fa-574cf409227c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2521da0c-7ae5-4602-941e-3c0a31bdcadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:06 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Volume volume-fdc0c21b-84a7-4efe-82fa-574cf409227c (fdc0c21b-84a7-4efe-82fa-574cf409227c): created successfully
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2521da0c-7ae5-4602-941e-3c0a31bdcadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Flow 'volume_create_manager' (1f486ec2-bc4c-4635-b9c8-8aa9e42b4e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Creating offline snapshot 54ab01c6-05f7-408d-a2d5-20d8a62c9f35 of volume d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4ddd365a-f80d-4e5b-81e8-27428bf83749 tempest-AbsoluteLimitsTests-795821957 None] Created volume successfully.
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac5735e-cc94-4cda-8b67-072e3cd81251]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:06 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:06 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:06 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d52a70f-cb75-4c85-9d3a-efa789031fae]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:07 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Acquiring lock "cinder-fdc0c21b-84a7-4efe-82fa-574cf409227c-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:07 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.572s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "cinder-fdc0c21b-84a7-4efe-82fa-574cf409227c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:07 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 1G
Apr 09 13:36:07 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Acquiring lock "cinder-quobyte-fdc0c21b-84a7-4efe-82fa-574cf409227c" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "cinder-quobyte-fdc0c21b-84a7-4efe-82fa-574cf409227c" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04efd47-95b6-4b19-b51e-b16d1a71ec19]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c
Apr 09 13:36:07 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:07 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.547s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack sudo[87412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc
Apr 09 13:36:07 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:07 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 1G" returned: 0 in 0.542s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ffcafa-89a3-4d00-884c-5a685c016645 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ffcafa-89a3-4d00-884c-5a685c016645 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:07 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:07 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:07 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c
Apr 09 13:36:07 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:08 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:08 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc
Apr 09 13:36:08 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:08 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ffcafa-89a3-4d00-884c-5a685c016645 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.701s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:08 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:08 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fdc0c21b-84a7-4efe-82fa-574cf409227c" returned: 0 in 0.695s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:08 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:08 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "cinder-quobyte-fdc0c21b-84a7-4efe-82fa-574cf409227c" released by "delete_volume" :: held 1.242s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Created reservations ['b08bcaf4-8a17-41f0-a707-b7a3ab20fe30', '6b23af3d-a19f-48c1-91c8-d64458132973', '6c11a58a-f789-4f3f-b422-2a4ec570619a', 'c02f562a-6256-487d-b748-894c5471916b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:08 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.b7143f8e-915d-4c05-8e88-58c66149e3dc" returned: 0 in 0.735s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:08 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:08 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-b7143f8e-915d-4c05-8e88-58c66149e3dc" released by "_delete_snapshot" :: held 2.422s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_snapshot" :: held 2.435s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Created reservations ['94878ef5-aba8-42e3-a0ba-851581d98a65', 'eb766681-a268-4407-b025-9279fbd72808', '233f31a0-0544-4091-9bec-4dd1871f568f', '496019f1-783d-4047-aab9-a0e373c0fb4b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:08 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Delete snapshot completed successfully.
Apr 09 13:36:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-222ab3c4-46d4-4032-be06-6a876bdcdc35 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-b7143f8e-915d-4c05-8e88-58c66149e3dc-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:09 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.552s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:09 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info
Apr 09 13:36:09 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:09 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.611s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Deleted volume successfully.
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4d9cca83-e9aa-411e-8330-0fceb9a31bda tempest-AbsoluteLimitsTests-795821957 None] Lock "cinder-fdc0c21b-84a7-4efe-82fa-574cf409227c-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:09 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info" returned: 0 in 0.639s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:09 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:09 devstack sudo[87473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info
Apr 09 13:36:09 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:10 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.info" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Acquiring lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] snapshot: 54ab01c6-05f7-408d-a2d5-20d8a62c9f35, volume: 010ba02f-6d92-46c6-a77e-cdd498c0a98d,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[492897ae-e1fb-4b31-b712-54775cd5d41f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:10 devstack sudo[87476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:10 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8321bfc5-ad33-4031-abb3-0372b7ded850 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" by "attach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8321bfc5-ad33-4031-abb3-0372b7ded850 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" acquired by "attach_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8321bfc5-ad33-4031-abb3-0372b7ded850 tempest-VolumesActionsTest-1638994864 None] Attaching volume 79c47451-2220-4f13-bd3e-01b80b37fd52 to instance 9121c6ec-4511-4562-b732-359869f248f0 at mountpoint /dev/vdb on host None.
Apr 09 13:36:10 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.659s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5ffcafa-89a3-4d00-884c-5a685c016645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:36:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8321bfc5-ad33-4031-abb3-0372b7ded850 tempest-VolumesActionsTest-1638994864 None] Attach volume completed successfully.
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f2774c-7e46-40b4-b703-33c9692c6ee5]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8321bfc5-ad33-4031-abb3-0372b7ded850 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52" released by "attach_volume" :: held 0.097s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:11 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:11 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8f307aea-11c0-46bb-b7d2-4a299c9a106a tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" by "detach_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8f307aea-11c0-46bb-b7d2-4a299c9a106a tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:11 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8f307aea-11c0-46bb-b7d2-4a299c9a106a tempest-VolumesActionsTest-1638994864 None] Detaching volume 79c47451-2220-4f13-bd3e-01b80b37fd52 from instance 9121c6ec-4511-4562-b732-359869f248f0.
Apr 09 13:36:11 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.598s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:11 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d
Apr 09 13:36:11 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:11 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8f307aea-11c0-46bb-b7d2-4a299c9a106a tempest-VolumesActionsTest-1638994864 None] Detach volume completed successfully.
Apr 09 13:36:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8f307aea-11c0-46bb-b7d2-4a299c9a106a tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Flow 'volume_create_manager' (f72ca127-dafb-4989-8027-21fab51cd9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27157c50-a84e-4c67-a1b7-be951dae3393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27157c50-a84e-4c67-a1b7-be951dae3393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1693636263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5a4e73-195a-4854-99c9-27bd2c21edaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd49fbdc18cd4a0080dbe3ffd4c6ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:13Z,use_quota=True,user_id='2ed63cdedd164deaa04cea3be1b01a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61293414-f17f-41fe-984f-4cc5357c3466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61293414-f17f-41fe-984f-4cc5357c3466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fb2519-7144-4b0e-987e-def26226dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.image.glance [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Creating Keystone auth plugin from conf {{(pid=82360) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fb2519-7144-4b0e-987e-def26226dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd5a4e73-195a-4854-99c9-27bd2c21edaf', 'volume_name': 'volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3af1420>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44250d2-a2f1-4ec0-a0f9-09ce0a82905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44250d2-a2f1-4ec0-a0f9-09ce0a82905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479d039-5869-4096-8aa2-d6f333b7c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:13 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Volume dd5a4e73-195a-4854-99c9-27bd2c21edaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3af1420>}
Apr 09 13:36:13 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Trying to clone dd5a4e73-195a-4854-99c9-27bd2c21edaf from image eee3377f-d552-4152-8887-ebf4bcaa9490 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]). {{(pid=82360) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 13:36:14 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6025f2-59fa-4f05-abcd-f395437ec0f2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:14 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD
Apr 09 13:36:14 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:14 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d" returned: 0 in 2.943s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[89896688-9baf-4fc5-9cf0-28caf29f0f77]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:14 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:14 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:14 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 is fetched for user 2ed63cdedd164deaa04cea3be1b01a4e. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f789ad47-f3e1-4483-9c8a-6abd88dfdeba]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:15 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD
Apr 09 13:36:15 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:15 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.661s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:36:15 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Converted 1024.00 MB image at 347.75 MB/s
Apr 09 13:36:15 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:15 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d
Apr 09 13:36:15 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:15 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:15 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" released by "_copy_volume_from_snapshot" :: held 5.363s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Acquiring lock "cinder-quobyte-54ab01c6-05f7-408d-a2d5-20d8a62c9f35" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-54ab01c6-05f7-408d-a2d5-20d8a62c9f35" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Deleting offline snapshot 54ab01c6-05f7-408d-a2d5-20d8a62c9f35 of volume d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] snapshot_file for this snap is: volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7550cf-00f4-4701-855f-365bed13398c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:15 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:15 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:16 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5ffcafa-89a3-4d00-884c-5a685c016645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c1106-b834-4c16-842a-189bbd47e745]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:16 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:16 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:16 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:16 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:16 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:17 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.436s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:17 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35
Apr 09 13:36:17 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:17 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645.54ab01c6-05f7-408d-a2d5-20d8a62c9f35" returned: 0 in 0.412s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-54ab01c6-05f7-408d-a2d5-20d8a62c9f35" released by "_delete_snapshot" :: held 1.868s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.876s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.598s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Creating offline snapshot c1cc84a6-e20c-4cd8-8e46-f04df413207f of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f447e0b-c7be-496c-b3ba-5ad5a2a35120]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:17 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a30528a3-1b70-46f7-a2bb-9d2bab6933c9 tempest-GroupsV314Test-1995630840 None] Create group from source-group-b5f111a2-2e81-46c1-909c-4e07fafb8251 completed successfully.
Apr 09 13:36:17 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:17 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:18 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:18 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f 1G
Apr 09 13:36:18 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Acquiring lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe4b99-99ec-4386-ac71-3ffa3c41ff7c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:18 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d
Apr 09 13:36:18 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:18 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f 1G" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:18 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f
Apr 09 13:36:18 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:18 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:18 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d
Apr 09 13:36:18 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:18 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:18 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f is being set with open permissions: ugo+rw
Apr 09 13:36:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:19 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f
Apr 09 13:36:19 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:19 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-010ba02f-6d92-46c6-a77e-cdd498c0a98d" returned: 0 in 0.480s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-010ba02f-6d92-46c6-a77e-cdd498c0a98d" released by "delete_volume" :: held 1.023s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Created reservations ['2ecad72c-369a-4728-9e82-38875f9960a3'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:19 devstack cinder-volume[82360]: WARNING cinder.quota [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1161966911 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1161966911, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:36:19 devstack cinder-volume[82360]: WARNING cinder.quota [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1161966911 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1161966911, it is now deprecated. Please use the default quota class for default quota.
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Created reservations ['4b954a86-8290-4b4e-92b9-fd4dd2ef732c', '1a592a12-e8ab-458b-920d-ecab5fac240f', '97fab7d3-a1fc-41f4-87be-38944b407cb6', '3031840c-8832-4ff0-8db9-09d6f89d49b2'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:19 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:19 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:19 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1693636263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5a4e73-195a-4854-99c9-27bd2c21edaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd49fbdc18cd4a0080dbe3ffd4c6ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:13Z,use_quota=True,user_id='2ed63cdedd164deaa04cea3be1b01a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Creating volume dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:19 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:19 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1073741824
Apr 09 13:36:19 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69f7b02c-c940-41b7-adfd-62aa4230a91e tempest-SnapshotsActionsTest-1260592481 None] Create snapshot completed successfully
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:19 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.446s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:19 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f9ecfeb2-5de3-4fb1-973d-3c8a20faa520 tempest-GroupsV314Test-1995630840 None] Delete group completed successfully.
Apr 09 13:36:20 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1073741824" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:20 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:20 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-c1cc84a6-e20c-4cd8-8e46-f04df413207f-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-c1cc84a6-e20c-4cd8-8e46-f04df413207f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-c1cc84a6-e20c-4cd8-8e46-f04df413207f" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-c1cc84a6-e20c-4cd8-8e46-f04df413207f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Deleting offline snapshot c1cc84a6-e20c-4cd8-8e46-f04df413207f of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] snapshot_file for this snap is: volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c68a1-1a76-4e6c-bbe0-e303dcbf60fa]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:20 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f
Apr 09 13:36:20 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:20 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 0.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.779s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d9d1d-63ce-4b0e-aa5c-208120029899]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Attempting download of eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume dd5a4e73-195a-4854-99c9-27bd2c21edaf. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Acquiring lock "cinder-quobyte-d5ffcafa-89a3-4d00-884c-5a685c016645" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-d5ffcafa-89a3-4d00-884c-5a685c016645" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860895f-9893-47c5-8164-fc33b2993f8b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:20 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:20 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d880502d-8ea8-40e8-9146-8b5fbc454f42]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:20 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:20 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:20 devstack sudo[87608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg
Apr 09 13:36:20 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:20 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f" returned: 0 in 0.542s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9528d4-5689-4004-92c8-13247ffca2fa]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:21 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.524s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[615e8f76-53ed-4b51-83b1-836b8c3143e1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:21 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.528s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645
Apr 09 13:36:21 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg
Apr 09 13:36:21 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.502s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f
Apr 09 13:36:21 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.9d441d83-45ce-4882-8862-620eb4539f9ayuwssxax.img {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.9d441d83-45ce-4882-8862-620eb4539f9ayuwssxax.img
Apr 09 13:36:21 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d5ffcafa-89a3-4d00-884c-5a685c016645" returned: 0 in 0.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Lock "cinder-quobyte-d5ffcafa-89a3-4d00-884c-5a685c016645" released by "delete_volume" :: held 1.014s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Created reservations ['a057499d-ee9d-4b90-8c92-393d3b723f9f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:21 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg" returned: 1 in 0.509s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_505t3isg' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ffd2c8-934f-4a1a-a282-a21b841de4db]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Created reservations ['fe23fd19-b967-4359-b73c-df803d0ab403', 'a5669f33-f111-4c8e-8459-a28815e2727d', 'f204ca80-f9a1-4216-8c47-077263c5f1d2', '552dfebc-20f2-43e2-bdfe-5a73900423e8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:21 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD
Apr 09 13:36:21 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:21 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:21 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:22 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f" returned: 0 in 0.574s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:22 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f
Apr 09 13:36:22 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:22 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:22 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.936s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD" returned: 0 in 1.058s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] eee3377f-d552-4152-8887-ebf4bcaa9490 was qcow2, converting to raw {{(pid=82360) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 13:36:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-23e51265-d3a3-49c9-a26c-98a5cde12770 tempest-GroupsV314Test-1995630840 None] Delete group completed successfully.
Apr 09 13:36:22 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:22 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:23 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.c1cc84a6-e20c-4cd8-8e46-f04df413207f" returned: 0 in 1.429s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-c1cc84a6-e20c-4cd8-8e46-f04df413207f" released by "_delete_snapshot" :: held 3.111s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_snapshot" :: held 3.130s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Created reservations ['33c92923-0c8e-4c76-9010-37a3ace1a483', '14d68590-1962-4336-9fb3-81dd18ed2984', '6ed15e8b-57cd-4934-acf6-b7a1285e9c81', '7ef4b9b4-6f49-4bbe-bd8c-f544825e4122'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Delete snapshot completed successfully.
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6bbb3bb4-fd41-4a58-a8ac-5cc6518a9f34 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-c1cc84a6-e20c-4cd8-8e46-f04df413207f-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:23 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.9d441d83-45ce-4882-8862-620eb4539f9ayuwssxax.img" returned: 0 in 2.192s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd34a2c-e112-4f2b-bb2b-43507b5c0fb7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:23 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:23 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:24 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 1.659s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_qb5itjhqdevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:36:24 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Converted 112.00 MB image at 67.43 MB/s
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:24 devstack sudo[87683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1G
Apr 09 13:36:24 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:24 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.776s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.9d441d83-45ce-4882-8862-620eb4539f9ayuwssxax.img {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:36:24 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Converted 1024.00 MB image at 467.02 MB/s
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] 9d441d83-45ce-4882-8862-620eb4539f9a was raw, no need to convert to raw {{(pid=82360) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 09 13:36:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:25 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 1G" returned: 0 in 0.607s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:25 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ef125-d45e-447e-9aa7-63dd79cffbac]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:25 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:25 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:25 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 0.593s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:25 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:25 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:26 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 1 in 0.571s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Downloaded image eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume dd5a4e73-195a-4854-99c9-27bd2c21edaf successfully. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 for user 2ed63cdedd164deaa04cea3be1b01a4e is deleted. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Marking volume dd5a4e73-195a-4854-99c9-27bd2c21edaf as bootable. {{(pid=82360) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Copying metadata from image eee3377f-d552-4152-8887-ebf4bcaa9490 to dd5a4e73-195a-4854-99c9-27bd2c21edaf. {{(pid=82360) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Creating volume glance metadata for volume dd5a4e73-195a-4854-99c9-27bd2c21edaf backed by image eee3377f-d552-4152-8887-ebf4bcaa9490 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82360) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479d039-5869-4096-8aa2-d6f333b7c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3af1420>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065c81ae-6f07-408a-8e3d-995766fabd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Volume volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf (dd5a4e73-195a-4854-99c9-27bd2c21edaf): created successfully
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065c81ae-6f07-408a-8e3d-995766fabd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Flow 'volume_create_manager' (f72ca127-dafb-4989-8027-21fab51cd9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-09333fcc-d48e-4c72-85d0-a1596d53a2d7 tempest-VolumesExtendTest-1035255140 None] Created volume successfully.
Apr 09 13:36:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.474s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Uploaded volume to glance image-id: 9d441d83-45ce-4882-8862-620eb4539f9a. {{(pid=82360) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.039s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Creating offline snapshot f85c92ad-4a4a-4e0a-972a-ec777c48e5ff of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1d207-d139-4fa9-b332-a6b360707023]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1943113a-4785-412f-af70-7fc237ea4b8f tempest-VolumesActionsTest-1638994864 None] Copy volume to image completed successfully.
Apr 09 13:36:35 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:35 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:35 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.604s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:35 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff 1G
Apr 09 13:36:35 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:36 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff 1G" returned: 0 in 0.608s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:36 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff
Apr 09 13:36:36 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:36 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" returned: 0 in 0.497s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:36 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff is being set with open permissions: ugo+rw
Apr 09 13:36:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:36 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff
Apr 09 13:36:36 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:37 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=165,cinder:SELECT=174,cinder:INSERT=62,cinder:DELETE=9 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:INSERT=44,cinder:SELECT=166,cinder:UPDATE=174,cinder:DELETE=7 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.931s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-777e2d3a-5638-4ea7-8c1b-b0cac172821b tempest-SnapshotsActionsTest-1260592481 None] Create snapshot completed successfully
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4420528-bd85-4e83-a437-8b0bddb6b3ed]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:37 devstack sudo[87727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:37 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:37 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 0.527s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:37 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:37 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:38 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 1 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 2G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf 2G" returned: 0 in 0.043s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.131s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.611s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd665763-750b-4474-b86a-da0042f2f52d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:38 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-aad43f17-adca-4abd-9277-d58f85cf4e91 tempest-VolumesExtendTest-1035255140 None] Extend volume completed successfully.
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Deleting offline snapshot f85c92ad-4a4a-4e0a-972a-ec777c48e5ff of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] snapshot_file for this snap is: volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e6e240-0819-4ff5-890b-1a7f204ce67c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:38 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:38 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:38 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff
Apr 09 13:36:38 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:38 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.515s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de084fe-cebc-48c9-a89e-5f748d8a26ef]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Flow 'volume_create_manager' (ecedd012-08da-4be7-8c28-e7dd484b577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:39 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:39 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cf5c4e-420b-4ac7-98ba-006ad3ca9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cf5c4e-420b-4ac7-98ba-006ad3ca9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1053586819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded5b122-ec13-4501-9b01-669fc30fd499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c649c992ad439bb63c2df487e7f90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:39Z,use_quota=True,user_id='934d0ff9255b47f38793fe0dbf1430d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cab621-63ed-4326-901e-d7d59cb1ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cab621-63ed-4326-901e-d7d59cb1ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1073b6c-3c0f-4430-b097-55ff5334bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1073b6c-3c0f-4430-b097-55ff5334bc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded5b122-ec13-4501-9b01-669fc30fd499', 'volume_name': 'volume-ded5b122-ec13-4501-9b01-669fc30fd499', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:39 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75507a96-961f-4cb3-a17c-26a11ea90e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75507a96-961f-4cb3-a17c-26a11ea90e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce98e8b-22e4-4078-af1e-045ad22f32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:39 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Volume ded5b122-ec13-4501-9b01-669fc30fd499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded5b122-ec13-4501-9b01-669fc30fd499', 'volume_size': 1}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" returned: 0 in 0.599s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ceea7-adca-49d0-b2d7-ca64cd81b0d1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-dd5a4e73-195a-4854-99c9-27bd2c21edaf-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-dd5a4e73-195a-4854-99c9-27bd2c21edaf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:39 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:39 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-quobyte-dd5a4e73-195a-4854-99c9-27bd2c21edaf" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-dd5a4e73-195a-4854-99c9-27bd2c21edaf" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5ad882-0acf-4e92-b697-28b9a9e96eb0]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:39 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:39 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img
Apr 09 13:36:39 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:39 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff
Apr 09 13:36:39 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:39 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:39 devstack sudo[87767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:39 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:40 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" returned: 0 in 0.665s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:40 devstack sudo[87782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff
Apr 09 13:36:40 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:40 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 1 in 1.117s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:40 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf
Apr 09 13:36:40 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:41 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" returned: 0 in 1.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff" released by "_delete_snapshot" :: held 3.245s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_snapshot" :: held 3.258s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:41 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img" returned: 0 in 2.305s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba7717d-cc54-43f2-a24e-4adf0a98d262]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Created reservations ['a82dae41-1b0d-4682-89b7-823d8756e26a', '3aaffb1b-8db6-461f-82d3-710760e97836', '7e098662-4ca5-4982-b8ed-174f129b1070', '16b24cbb-a035-4517-82fb-3f56e8691a94'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Delete snapshot completed successfully.
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8bc06bbe-bbc8-4cf7-957a-d5142632265c tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-f85c92ad-4a4a-4e0a-972a-ec777c48e5ff-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:41 devstack sudo[87790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:41 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:41 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dd5a4e73-195a-4854-99c9-27bd2c21edaf" returned: 0 in 1.049s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-dd5a4e73-195a-4854-99c9-27bd2c21edaf" released by "delete_volume" :: held 2.704s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Created reservations ['31c6e589-171e-4f54-935c-c273cea3968a', '0529fa14-b501-45ee-8570-93836835eb52', '086414bb-2463-45bc-98f9-90ab4208fab2', 'e7bea33a-5997-46f0-8a3e-aa49697968e0'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:42 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:42 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:42 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.637s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:36:42 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Converted 1024.00 MB image at 444.06 MB/s
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] 2ddb570f-6937-4f69-9c3b-9a643c27c5d7 was raw, converting to qcow2 {{(pid=82360) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acbe172-9a82-4db2-8a30-90b886d31ed4]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:42 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.432s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Deleted volume successfully.
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d58820ea-aeb7-47fd-8768-df46c7791a8a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-dd5a4e73-195a-4854-99c9-27bd2c21edaf-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:42 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img
Apr 09 13:36:42 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Flow 'volume_create_manager' (2ada1813-526a-4112-9ab2-18efb70a1613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa492be-49ea-4ec8-9543-85a87285d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa492be-49ea-4ec8-9543-85a87285d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1820704017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c3e6f6-f8b7-4dca-b96d-f834fb9f9830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd49fbdc18cd4a0080dbe3ffd4c6ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:43Z,use_quota=True,user_id='2ed63cdedd164deaa04cea3be1b01a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2ddab7-3ce0-4939-a5da-7788a8b17730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2ddab7-3ce0-4939-a5da-7788a8b17730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d89227-2582-4669-a483-8a8f917524f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d89227-2582-4669-a483-8a8f917524f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c3e6f6-f8b7-4dca-b96d-f834fb9f9830', 'volume_name': 'volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6b42ab-3020-4cba-b71f-71cd08b27c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6b42ab-3020-4cba-b71f-71cd08b27c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdff20b-27d8-4028-a076-1c13b01846c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:42 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Volume 93c3e6f6-f8b7-4dca-b96d-f834fb9f9830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830', 'volume_size': 1}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:42 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img" returned: 0 in 0.531s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:43 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img
Apr 09 13:36:43 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:43 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img" returned: 1 in 0.464s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img /opt/stack/data/cinder/conversion/vol_upload_59zlooq_ {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:43 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img /opt/stack/data/cinder/conversion/vol_upload_59zlooq_
Apr 09 13:36:43 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:43 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img /opt/stack/data/cinder/conversion/vol_upload_59zlooq_" returned: 0 in 0.416s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Image conversion details: src /opt/stack/data/cinder/conversion/79c47451-2220-4f13-bd3e-01b80b37fd52.temp_image.2ddb570f-6937-4f69-9c3b-9a643c27c5d7tv_ry173.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_59zlooq_ {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:36:43 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4b60cf-ac5c-4f81-aac7-9ea85b02e07a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59zlooq_ {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:43 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59zlooq_
Apr 09 13:36:43 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:44 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59zlooq_" returned: 0 in 0.477s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.752s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Uploaded volume to glance image-id: 2ddb570f-6937-4f69-9c3b-9a643c27c5d7. {{(pid=82360) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.075s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1053586819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded5b122-ec13-4501-9b01-669fc30fd499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c649c992ad439bb63c2df487e7f90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:39Z,use_quota=True,user_id='934d0ff9255b47f38793fe0dbf1430d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Creating volume ded5b122-ec13-4501-9b01-669fc30fd499 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:45 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-832c49cb-b1d7-4656-ad03-09b9e8b07d6b tempest-VolumesActionsTest-1638994864 None] Copy volume to image completed successfully.
Apr 09 13:36:45 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 1073741824
Apr 09 13:36:45 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:45 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 1073741824" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:45 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499
Apr 09 13:36:45 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:46 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499" returned: 0 in 0.442s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.326s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1820704017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c3e6f6-f8b7-4dca-b96d-f834fb9f9830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd49fbdc18cd4a0080dbe3ffd4c6ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:43Z,use_quota=True,user_id='2ed63cdedd164deaa04cea3be1b01a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Creating volume 93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:46 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce98e8b-22e4-4078-af1e-045ad22f32fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded5b122-ec13-4501-9b01-669fc30fd499', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdbda3-83e7-491d-b96d-8b002de1ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:46 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 1073741824
Apr 09 13:36:46 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:46 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Volume volume-ded5b122-ec13-4501-9b01-669fc30fd499 (ded5b122-ec13-4501-9b01-669fc30fd499): created successfully
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdbda3-83e7-491d-b96d-8b002de1ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Flow 'volume_create_manager' (ecedd012-08da-4be7-8c28-e7dd484b577c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-537650d7-7254-41e7-843d-2d58368e8f42 tempest-VolumesTransfersTest-581806265 None] Created volume successfully.
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "cinder-quobyte-79c47451-2220-4f13-bd3e-01b80b37fd52" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-quobyte-79c47451-2220-4f13-bd3e-01b80b37fd52" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d3e346-9209-46c1-baea-6d82a5ffa960]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:46 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:46 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:46 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 1073741824" returned: 0 in 0.608s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:46 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:46 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-96b4aa3d-99d9-47f7-90db-7085125327fd tempest-VolumesTransfersTest-89511626 None] Transfer volume completed successfully.
Apr 09 13:36:47 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:47 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52
Apr 09 13:36:47 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:47 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.459s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.363s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdff20b-27d8-4028-a076-1c13b01846c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3142689-5873-4738-a7a1-43acdb67e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:47 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Volume volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 (93c3e6f6-f8b7-4dca-b96d-f834fb9f9830): created successfully
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3142689-5873-4738-a7a1-43acdb67e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Flow 'volume_create_manager' (2ada1813-526a-4112-9ab2-18efb70a1613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Creating offline snapshot 561eb10d-452f-4a90-a92c-6791506749af of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-85508e24-cdce-461d-9525-395c60c2e720 tempest-VolumesExtendTest-1035255140 None] Created volume successfully.
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c9236-c1fe-4e75-9fcb-907bd01db28f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:47 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:47 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:47 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-79c47451-2220-4f13-bd3e-01b80b37fd52" returned: 0 in 0.472s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-quobyte-79c47451-2220-4f13-bd3e-01b80b37fd52" released by "delete_volume" :: held 1.081s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Created reservations ['de617a0b-65bb-4254-b5ce-54490c618e3b', '14b6aa18-d21e-488f-b82a-2d8b3c195585', '289a952e-3cce-4faf-a7f4-1d51e7bcfe8c', '9fdeee64-f0ef-454d-8c5e-883e4dca32eb'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "cinder-ded5b122-ec13-4501-9b01-669fc30fd499-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:47 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:47 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-ded5b122-ec13-4501-9b01-669fc30fd499-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "cinder-quobyte-ded5b122-ec13-4501-9b01-669fc30fd499" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-quobyte-ded5b122-ec13-4501-9b01-669fc30fd499" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[36675290-bd50-4f25-a4b9-714ef374393b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:47 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.552s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:47 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af 1G
Apr 09 13:36:47 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:47 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499
Apr 09 13:36:47 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:48 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.477s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Deleted volume successfully.
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-00b61643-a0cb-473e-942b-7b1cee8d17b2 tempest-VolumesActionsTest-1638994864 None] Lock "cinder-79c47451-2220-4f13-bd3e-01b80b37fd52-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:48 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:48 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499
Apr 09 13:36:48 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:48 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af 1G" returned: 0 in 0.539s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:48 devstack sudo[87897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af
Apr 09 13:36:48 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:48 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ded5b122-ec13-4501-9b01-669fc30fd499" returned: 0 in 0.425s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-quobyte-ded5b122-ec13-4501-9b01-669fc30fd499" released by "delete_volume" :: held 0.986s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Created reservations ['6f03a837-1ee4-46b8-8415-6427a77e950e', 'b9463971-d730-4abc-816a-5f773745a36e', 'a1515232-b531-4684-98cd-9c9aa2d2e300', 'eb633bbf-420b-470b-9edf-cb5e66199aa5'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:48 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:48 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af is being set with open permissions: ugo+rw
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:48 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af
Apr 09 13:36:48 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:48 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:48 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:49 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:49 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.250s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b8908fd7-1a2f-4f59-9110-55e69ccd7f79 tempest-SnapshotsActionsTest-1260592481 None] Create snapshot completed successfully
Apr 09 13:36:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Deleted volume successfully.
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Creating offline snapshot 05a07863-624d-419c-8e3c-31f8b4fb41c4 of volume 93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9de6fd81-2dcb-4751-89f7-55cad5a3a3d4 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-ded5b122-ec13-4501-9b01-669fc30fd499-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3caf532-9509-4bd7-8dc9-3c995db676fe]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:49 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:49 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:49 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.531s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:50 devstack sudo[87916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 1G
Apr 09 13:36:50 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-561eb10d-452f-4a90-a92c-6791506749af-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-561eb10d-452f-4a90-a92c-6791506749af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Acquiring lock "cinder-quobyte-561eb10d-452f-4a90-a92c-6791506749af" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Flow 'volume_create_manager' (8dc982d3-927b-4685-bf4f-2a85b6a13915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f28e088-62c2-40ed-b5d7-8a6c6972b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f28e088-62c2-40ed-b5d7-8a6c6972b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1782751978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7abba1-b3c9-478f-ae6e-d53b247ea89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c649c992ad439bb63c2df487e7f90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:50Z,use_quota=True,user_id='934d0ff9255b47f38793fe0dbf1430d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb79efd0-1bcd-40b8-8913-6b48e145df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb79efd0-1bcd-40b8-8913-6b48e145df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53d0f5d-d343-4910-b6d0-42af1c3e417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53d0f5d-d343-4910-b6d0-42af1c3e417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7abba1-b3c9-478f-ae6e-d53b247ea89a', 'volume_name': 'volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca14f13-9079-46c7-862c-b7601455001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca14f13-9079-46c7-862c-b7601455001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6acb0d-3ce7-4605-8b70-23176a853e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:50 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Volume ad7abba1-b3c9-478f-ae6e-d53b247ea89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a', 'volume_size': 1}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-561eb10d-452f-4a90-a92c-6791506749af" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Deleting offline snapshot 561eb10d-452f-4a90-a92c-6791506749af of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] snapshot_file for this snap is: volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef86a3-b7d0-4eb2-8167-955ff020e39e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:50 devstack sudo[87918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af
Apr 09 13:36:50 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:50 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 1G" returned: 0 in 0.657s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:50 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4
Apr 09 13:36:50 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:50 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af" returned: 0 in 0.609s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b86a59f-ad95-401c-90bf-89ed4aca9aa7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:51 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:51 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:51 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:51 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 is being set with open permissions: ugo+rw
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:51 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4
Apr 09 13:36:51 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:51 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.586s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:51 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af
Apr 09 13:36:51 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:51 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4" returned: 0 in 0.523s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:51 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info
Apr 09 13:36:51 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:52 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af" returned: 0 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:52 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af
Apr 09 13:36:52 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:52 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:52 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info is being set with open permissions: ugo+rw
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:52 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info
Apr 09 13:36:52 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:52 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.561eb10d-452f-4a90-a92c-6791506749af" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-561eb10d-452f-4a90-a92c-6791506749af" released by "_delete_snapshot" :: held 2.267s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_snapshot" :: held 2.347s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:52 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.info" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1782751978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7abba1-b3c9-478f-ae6e-d53b247ea89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c649c992ad439bb63c2df487e7f90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:50Z,use_quota=True,user_id='934d0ff9255b47f38793fe0dbf1430d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Creating volume ad7abba1-b3c9-478f-ae6e-d53b247ea89a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:52 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Created reservations ['e2b8fa19-03a4-4ab9-997c-8ef835106d61', '49dd71ec-9975-405b-b25a-660002cecff5', 'f486a56d-a179-4502-8bcf-e7029b30f0f0', '85d6a099-0e25-417b-ada1-b1fa643ba5e1'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:52 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a 1073741824
Apr 09 13:36:52 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ce872e6d-22ca-47bb-96d0-41112c8c5525 tempest-VolumesExtendTest-1035255140 None] Create snapshot completed successfully
Apr 09 13:36:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Delete snapshot completed successfully.
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b1fe33ca-382b-4ee1-abc5-75fccf7af622 tempest-SnapshotsActionsTest-412123942 None] Lock "cinder-561eb10d-452f-4a90-a92c-6791506749af-delete_snapshot" released by "delete_snapshot" :: held 2.522s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Flow 'volume_create_manager' (c4daecfd-9d34-45cb-9448-84c8307b9c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b06417-ef05-4680-9749-81472804753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b06417-ef05-4680-9749-81472804753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1162725207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b3f68e-6d6b-432d-ab8f-977e95d71af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b34fd1459c40eba0cf45ae5e34145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:53Z,use_quota=True,user_id='915e67a3d26c47719f6a6b68e31bfebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1eea14-27d6-47fe-ae2c-95f44838d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1eea14-27d6-47fe-ae2c-95f44838d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15bb6bb-1942-4794-97d9-20e06e2eba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15bb6bb-1942-4794-97d9-20e06e2eba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'volume_name': 'volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c284fdfd-e530-40ad-82f0-09f8131d08d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c284fdfd-e530-40ad-82f0-09f8131d08d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32585e63-9dac-4a08-aa29-cc0ba6ac1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:52 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Volume 13b3f68e-6d6b-432d-ab8f-977e95d71af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'volume_size': 1}
Apr 09 13:36:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:53 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a 1073741824" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:53 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a
Apr 09 13:36:53 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:53 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" returned: 0 in 0.462s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1162725207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b3f68e-6d6b-432d-ab8f-977e95d71af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b34fd1459c40eba0cf45ae5e34145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:53Z,use_quota=True,user_id='915e67a3d26c47719f6a6b68e31bfebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Creating volume 13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:36:53 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "cinder-6ce22e7d-cb41-4d06-873b-4367d0623df0-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:53 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 1073741824
Apr 09 13:36:53 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6acb0d-3ce7-4605-8b70-23176a853e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68970a01-cb93-4ae2-9618-2218f17af2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Volume volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a (ad7abba1-b3c9-478f-ae6e-d53b247ea89a): created successfully
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68970a01-cb93-4ae2-9618-2218f17af2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Flow 'volume_create_manager' (8dc982d3-927b-4685-bf4f-2a85b6a13915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-6ce22e7d-cb41-4d06-873b-4367d0623df0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-71349ac7-0250-411f-9883-8b0d3dd9153d tempest-VolumesTransfersTest-581806265 None] Created volume successfully.
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "cinder-quobyte-6ce22e7d-cb41-4d06-873b-4367d0623df0" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-6ce22e7d-cb41-4d06-873b-4367d0623df0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Deleting offline snapshot 6ce22e7d-cb41-4d06-873b-4367d0623df0 of volume 2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] snapshot_file for this snap is: volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd7c51a-c89f-4c9d-bb01-38cc6a73730f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:53 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:53 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:54 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 1073741824" returned: 0 in 0.476s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:54 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:36:54 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:54 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b875ee6-920e-49f7-8c92-5c533a320d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e2fd6-a3b2-4194-8715-b879a6325570]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:54 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84
Apr 09 13:36:54 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:54 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.232s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c95842-094c-4ff1-a1c0-06dfe1fd4e4a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32585e63-9dac-4a08-aa29-cc0ba6ac1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6f9e03-9fe1-42b5-97ca-5a619f8bc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Volume volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 (13b3f68e-6d6b-432d-ab8f-977e95d71af3): created successfully
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6f9e03-9fe1-42b5-97ca-5a619f8bc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Flow 'volume_create_manager' (c4daecfd-9d34-45cb-9448-84c8307b9c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-928a6e3c-b24d-46dc-b712-15cf434aaae4 tempest-VolumesCloneTest-2092525360 None] Created volume successfully.
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "cinder-ad7abba1-b3c9-478f-ae6e-d53b247ea89a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-ad7abba1-b3c9-478f-ae6e-d53b247ea89a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:54 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:54 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "cinder-quobyte-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:54 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84" returned: 0 in 0.534s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-quobyte-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8667d-5622-4d5d-9d78-09642fb23423]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:54 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:54 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:54 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a
Apr 09 13:36:54 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:55 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.608s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 2G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Flow 'volume_create_manager' (51bcbe4e-89ff-435d-93c6-cf249041625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d7c2a9-b2ef-4e79-9255-6a5df825605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:55 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d7c2a9-b2ef-4e79-9255-6a5df825605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-727512272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066fa3b3-11b0-4663-952a-03e7bf29ef1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b34fd1459c40eba0cf45ae5e34145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=13b3f68e-6d6b-432d-ab8f-977e95d71af3,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:55Z,use_quota=True,user_id='915e67a3d26c47719f6a6b68e31bfebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8942630d-39c8-4f48-8275-b20afc38bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8942630d-39c8-4f48-8275-b20afc38bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3632d41e-35cc-4f1f-8c08-6059513dd7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 2G" returned: 0 in 0.112s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.739s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:55 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0
Apr 09 13:36:55 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3632d41e-35cc-4f1f-8c08-6059513dd7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '066fa3b3-11b0-4663-952a-03e7bf29ef1d', 'volume_name': 'volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d', 'volume_size': 2, 'source_volid': '13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fe3090-9676-4cfd-9fa7-ed08c93be308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fe3090-9676-4cfd-9fa7-ed08c93be308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4954e3fd-bb6b-4ab3-ae12-022299b65a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:36:55 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Volume 066fa3b3-11b0-4663-952a-03e7bf29ef1d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d', 'volume_size': 2, 'source_volid': '13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'source_volstatus': 'available'}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:55 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Cloning volume 13b3f68e-6d6b-432d-ab8f-977e95d71af3 to volume 066fa3b3-11b0-4663-952a-03e7bf29ef1d
Apr 09 13:36:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2624c165-799b-43cf-ab9b-2a49990b30f2 tempest-VolumesExtendTest-1035255140 None] Extend volume completed successfully.
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Creating offline snapshot d541d2ff-5d49-4987-9fe2-a744f6449ded of volume 13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51628c1-4c8f-454d-b403-fe1d0237921a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:55 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" returned: 0 in 0.648s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:55 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a
Apr 09 13:36:55 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:55 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:36:55 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-05a07863-624d-419c-8e3c-31f8b4fb41c4-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-05a07863-624d-419c-8e3c-31f8b4fb41c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-quobyte-05a07863-624d-419c-8e3c-31f8b4fb41c4" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-05a07863-624d-419c-8e3c-31f8b4fb41c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Deleting offline snapshot 05a07863-624d-419c-8e3c-31f8b4fb41c4 of volume 93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] snapshot_file for this snap is: volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ffcff5-3a61-42a5-821a-f47243decc72]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:55 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4
Apr 09 13:36:55 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:55 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84.6ce22e7d-cb41-4d06-873b-4367d0623df0" returned: 0 in 0.501s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-6ce22e7d-cb41-4d06-873b-4367d0623df0" released by "_delete_snapshot" :: held 2.156s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_snapshot" :: held 2.168s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Created reservations ['d05e67dd-78c1-432b-a533-bce743823920', '04cd6219-152e-434c-8331-1b05b530d2b3', '5a13ae44-0693-4d5e-bfdd-3ff5c4a64bba', '697c049c-593d-4365-8558-6e8323482c80'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Delete snapshot completed successfully.
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-bf83ec31-95f9-42d5-b290-f7a6206bfd0d tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-6ce22e7d-cb41-4d06-873b-4367d0623df0-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:55 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-quobyte-ad7abba1-b3c9-478f-ae6e-d53b247ea89a" released by "delete_volume" :: held 1.166s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Created reservations ['8dbfef93-79f9-4a4f-a5a4-58b0e4842841', 'c9cff6aa-1983-4508-a314-9e5296f82497', '9d421fab-9c6f-442a-abc9-0cf0add14cf9', '2fb27281-b3cb-4b64-a2c4-0d85d7b664fb'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:56 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.587s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:56 devstack sudo[88012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded 1G
Apr 09 13:36:56 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:56 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:56 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:56 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4" returned: 0 in 0.545s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b688577-d4a9-4762-88ac-2089b35c927c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:56 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:56 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:56 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.461s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:56 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Deleted volume successfully.
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3acb7df4-a5fb-45c5-a83c-18f686c3e750 tempest-VolumesTransfersTest-16541866 None] Lock "cinder-ad7abba1-b3c9-478f-ae6e-d53b247ea89a-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:56 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded 1G" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:56 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:36:56 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:56 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.503s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:56 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4
Apr 09 13:36:56 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "cinder-2b875ee6-920e-49f7-8c92-5c533a320d84-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-2b875ee6-920e-49f7-8c92-5c533a320d84-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce7b37-5c21-4d18-a419-7868bee5fad7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:57 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84
Apr 09 13:36:57 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:57 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.506s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:57 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded is being set with open permissions: ugo+rw
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:57 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:36:57 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:57 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4" returned: 0 in 0.541s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:57 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4
Apr 09 13:36:57 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:57 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84" returned: 0 in 0.547s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:57 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84
Apr 09 13:36:57 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:57 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:57 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info
Apr 09 13:36:57 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:57 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830.05a07863-624d-419c-8e3c-31f8b4fb41c4" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-05a07863-624d-419c-8e3c-31f8b4fb41c4" released by "_delete_snapshot" :: held 2.173s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" released by "delete_snapshot" :: held 2.195s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:57 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Created reservations ['0a8f220c-84a4-4dbd-bcc3-46764ffd58ad', '3eb2152e-f9c8-4e78-827d-14a4793c3769', '3773c0ff-0a5e-4d96-a2c9-9e4ad7077a77', '35309072-d624-4ee1-9e3a-5d4ff0c28f62'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Delete snapshot completed successfully.
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-67800172-abc2-49b5-a2d1-9a9f1aa9563a tempest-VolumesExtendTest-1035255140 None] Lock "cinder-05a07863-624d-419c-8e3c-31f8b4fb41c4-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:58 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2b875ee6-920e-49f7-8c92-5c533a320d84" returned: 0 in 0.569s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-quobyte-2b875ee6-920e-49f7-8c92-5c533a320d84" released by "delete_volume" :: held 1.148s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Created reservations ['25131365-c978-4728-acda-31c96389f5ae', 'caa63cec-105e-4f7b-ba6c-6e15fbf4f32e', 'c20fbaeb-5a7d-4f16-b4d2-0f502870a18d', '070973a3-5c3d-43c9-8d0d-c66bf0ef83c7'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:36:58 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:58 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info is being set with open permissions: ugo+rw
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:58 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info
Apr 09 13:36:58 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:58 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:36:58 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:58 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.info" returned: 0 in 0.513s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] snapshot: d541d2ff-5d49-4987-9fe2-a744f6449ded, volume: 066fa3b3-11b0-4663-952a-03e7bf29ef1d,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:36:58 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:36:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Deleted volume successfully.
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0190fbd5-0cf7-412a-8b33-3fcd5c71da34]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2560efe8-0036-4eda-81e2-6f99209fd6d2 tempest-SnapshotsActionsTest-1260592481 None] Lock "cinder-2b875ee6-920e-49f7-8c92-5c533a320d84-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:36:58 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:36:58 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "cinder-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Acquiring lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:36:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc93e63f-6bb1-4231-ab59-149f9e7143bc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:59 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:59 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:59 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.597s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697f7a2-7258-413d-b6ea-7e6ee7b14f49]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:59 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:36:59 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:59 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.638s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:59 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830
Apr 09 13:36:59 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:36:59 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.614s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:36:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:36:59 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d
Apr 09 13:36:59 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:00 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" returned: 0 in 0.551s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "cinder-quobyte-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830" released by "delete_volume" :: held 1.229s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Created reservations ['2fa0b22c-abca-468b-94d7-58e47a6f53b8', '5b73585a-b385-42e9-aee5-e5dc371c4ecf', '89f39ac4-d7cd-48d9-a723-ee6d45c28a26', '2e79b02d-6802-4052-859f-a66bb2cd6e78'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:00 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:00 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (6cc6bc12-e697-4231-9dc2-cf03da581c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d5103a-524a-4a36-8da2-4a8e98c6ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d5103a-524a-4a36-8da2-4a8e98c6ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1851416902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01aca99-40f7-4e4e-88a7-9b013545ae8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:00Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d48a24-02bc-406a-90a2-f0ccb67b9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d48a24-02bc-406a-90a2-f0ccb67b9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f809b5d-fe86-4514-90aa-2c42ee98be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f809b5d-fe86-4514-90aa-2c42ee98be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01aca99-40f7-4e4e-88a7-9b013545ae8c', 'volume_name': 'volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d9e45a-a51f-4204-950d-ad4ed7b498ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d9e45a-a51f-4204-950d-ad4ed7b498ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e4a6be-409c-47d9-bb03-14caede4f603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:00 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Volume d01aca99-40f7-4e4e-88a7-9b013545ae8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c', 'volume_size': 1}
Apr 09 13:37:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:01 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 1.201s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:01 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Deleted volume successfully.
Apr 09 13:37:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7eef567-5e8a-4d1a-92a4-7732e26092da tempest-VolumesExtendTest-1035255140 None] Lock "cinder-93c3e6f6-f8b7-4dca-b96d-f834fb9f9830-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:02 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d" returned: 0 in 2.408s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac72ac2-0734-4be2-a861-71be9f9d1753]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:02 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:37:02 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:03 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.787s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:37:03 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Converted 1024.00 MB image at 425.10 MB/s
Apr 09 13:37:03 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d is being set with open permissions: ugo+rw
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:03 devstack sudo[88100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d
Apr 09 13:37:03 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:03 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" released by "_copy_volume_from_snapshot" :: held 4.949s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-quobyte-d541d2ff-5d49-4987-9fe2-a744f6449ded" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-d541d2ff-5d49-4987-9fe2-a744f6449ded" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Deleting offline snapshot d541d2ff-5d49-4987-9fe2-a744f6449ded of volume 13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] snapshot_file for this snap is: volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec83e1a0-03c7-439b-b02a-15e41e4ff0e3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:03 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:37:03 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Flow 'volume_create_manager' (603e8d9e-ffbc-4e8f-99e3-2e4519c61e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ee21bb-ec61-4f56-b035-db6f13365221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ee21bb-ec61-4f56-b035-db6f13365221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-300615379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe28086d-47a5-48d6-8748-763e37ea0762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f83939be9e4906a9866d890dc197c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:04Z,use_quota=True,user_id='f4e42cb276e14ef4aaa60c35089d35ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4009496a-d420-42fd-8910-49bd05062c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4009496a-d420-42fd-8910-49bd05062c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82198db-df27-41fc-bd76-6cead6cb0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82198db-df27-41fc-bd76-6cead6cb0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe28086d-47a5-48d6-8748-763e37ea0762', 'volume_name': 'volume-fe28086d-47a5-48d6-8748-763e37ea0762', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e4429a-7fd7-4153-ad0d-28dd452443eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e4429a-7fd7-4153-ad0d-28dd452443eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f88542-aea0-4e15-91e9-090035ab194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:04 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Volume fe28086d-47a5-48d6-8748-763e37ea0762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe28086d-47a5-48d6-8748-763e37ea0762', 'volume_size': 1}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:04 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6f568-8394-4538-8eeb-e2928e286bd9]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:04 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:37:04 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:04 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:04 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:37:04 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:05 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:05 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:05 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:05 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded
Apr 09 13:37:05 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (3ed2b052-2343-4140-ad90-b29adf9416bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144edcb-da7f-43d3-a450-ff629f1b2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144edcb-da7f-43d3-a450-ff629f1b2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1238990544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:05Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3071aeae-616a-4b82-a3af-24da00369df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3071aeae-616a-4b82-a3af-24da00369df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa182dd-d255-4d25-a19b-49e9de7f6e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa182dd-d255-4d25-a19b-49e9de7f6e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e', 'volume_name': 'volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19dd115-ea34-4208-ba7a-0f403161505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19dd115-ea34-4208-ba7a-0f403161505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaf1920-75ea-4e96-be3f-c81ca802ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Volume ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e', 'volume_size': 1}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:05 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:05 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3.d541d2ff-5d49-4987-9fe2-a744f6449ded" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-d541d2ff-5d49-4987-9fe2-a744f6449ded" released by "_delete_snapshot" :: held 2.119s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.365s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.352s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1851416902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01aca99-40f7-4e4e-88a7-9b013545ae8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:00Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Creating volume d01aca99-40f7-4e4e-88a7-9b013545ae8c {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:05 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4954e3fd-bb6b-4ab3-ae12-022299b65a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d', 'volume_size': 2, 'source_volid': '13b3f68e-6d6b-432d-ab8f-977e95d71af3', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beea3ec7-0a47-42b0-91f7-ac21d6225d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:05 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c 1073741824
Apr 09 13:37:05 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:05 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Volume volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d (066fa3b3-11b0-4663-952a-03e7bf29ef1d): created successfully
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beea3ec7-0a47-42b0-91f7-ac21d6225d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:05 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Flow 'volume_create_manager' (51bcbe4e-89ff-435d-93c6-cf249041625f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9e3c31d9-835b-4210-a0a6-a06ca82a643f tempest-VolumesCloneTest-2092525360 None] Created volume successfully.
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-066fa3b3-11b0-4663-952a-03e7bf29ef1d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "cinder-066fa3b3-11b0-4663-952a-03e7bf29ef1d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a45b6e-609e-44ee-8576-372b104ab586]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:06 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d
Apr 09 13:37:06 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:06 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c 1073741824" returned: 0 in 0.568s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:06 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c
Apr 09 13:37:06 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:06 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d" returned: 0 in 0.506s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:06 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d
Apr 09 13:37:06 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:06 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c" returned: 0 in 0.405s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-300615379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe28086d-47a5-48d6-8748-763e37ea0762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f83939be9e4906a9866d890dc197c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:04Z,use_quota=True,user_id='f4e42cb276e14ef4aaa60c35089d35ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Creating volume fe28086d-47a5-48d6-8748-763e37ea0762 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:06 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e4a6be-409c-47d9-bb03-14caede4f603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf6af85-38cf-4a57-86ce-f43dc05730e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:06 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 1073741824
Apr 09 13:37:06 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:06 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Volume volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c (d01aca99-40f7-4e4e-88a7-9b013545ae8c): created successfully
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf6af85-38cf-4a57-86ce-f43dc05730e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (6cc6bc12-e697-4231-9dc2-cf03da581c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e0522fb7-b6d0-4318-bee2-caf6772d0e3a tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:07 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-066fa3b3-11b0-4663-952a-03e7bf29ef1d" returned: 0 in 0.444s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-066fa3b3-11b0-4663-952a-03e7bf29ef1d" released by "delete_volume" :: held 0.969s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Created reservations ['260aa13e-3574-485d-84ed-c28d89503867', 'bf92bc46-a0da-4594-8e1b-360bd848ec1b', '7f4b6b58-9d3a-440d-83ed-af217a6be944', '0841df50-ebe6-490d-9681-7b8cf2e2417d'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:07 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:07 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:07 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 1073741824" returned: 0 in 0.518s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-13b3f68e-6d6b-432d-ab8f-977e95d71af3-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:07 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762
Apr 09 13:37:07 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "cinder-13b3f68e-6d6b-432d-ab8f-977e95d71af3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Acquiring lock "cinder-quobyte-13b3f68e-6d6b-432d-ab8f-977e95d71af3" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-13b3f68e-6d6b-432d-ab8f-977e95d71af3" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a136ce-19b8-44d6-92f4-bd93ee349283]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:07 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:37:07 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:07 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Deleted volume successfully.
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4b6d3926-c95e-4fb2-8065-db7e6a5d033a tempest-VolumesCloneTest-2092525360 None] Lock "cinder-066fa3b3-11b0-4663-952a-03e7bf29ef1d-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:07 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.309s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1238990544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:05Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Creating volume ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:07 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f88542-aea0-4e15-91e9-090035ab194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe28086d-47a5-48d6-8748-763e37ea0762', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00530b10-c9c2-44aa-9b8d-d675880cee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:07 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e 1073741824
Apr 09 13:37:07 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Volume volume-fe28086d-47a5-48d6-8748-763e37ea0762 (fe28086d-47a5-48d6-8748-763e37ea0762): created successfully
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00530b10-c9c2-44aa-9b8d-d675880cee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Flow 'volume_create_manager' (603e8d9e-ffbc-4e8f-99e3-2e4519c61e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:07 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d8ab0ca2-62ad-4348-992e-64512a504104 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Created volume successfully.
Apr 09 13:37:07 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.544s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:08 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3
Apr 09 13:37:08 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:08 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e 1073741824" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:08 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e
Apr 09 13:37:08 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:08 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-13b3f68e-6d6b-432d-ab8f-977e95d71af3" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "cinder-quobyte-13b3f68e-6d6b-432d-ab8f-977e95d71af3" released by "delete_volume" :: held 1.058s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (fe001218-1bcd-4de7-b5bf-225b175b7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109f8786-ba3e-4b2f-8054-55858445c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109f8786-ba3e-4b2f-8054-55858445c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446648053',display_name='tempest-VolumesGetTest-Volume-667352129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3f541b-02bf-4c78-a071-846e0a4b25f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:08Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5391b94b-ac80-455b-b46a-617310170c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5391b94b-ac80-455b-b46a-617310170c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d62fe44-887e-4838-a599-2c6241f028f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d62fe44-887e-4838-a599-2c6241f028f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3f541b-02bf-4c78-a071-846e0a4b25f9', 'volume_name': 'volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee72853-bdc4-450e-ad73-d1d7fbca7af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee72853-bdc4-450e-ad73-d1d7fbca7af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cd2466-1810-4631-924e-6beb4384a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Volume 1d3f541b-02bf-4c78-a071-846e0a4b25f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9', 'volume_size': 1}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Created reservations ['ca014531-bd58-4030-9e54-0348d0058cba', '5306f130-d418-4a74-8407-1b8aed6aaedd', 'ee3c2a61-6b8e-4ad2-bd95-8e4744095b23', 'dc9e5f1b-c2cd-4888-bc21-84342926a359'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:08 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:08 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Acquiring lock "cinder-fe28086d-47a5-48d6-8748-763e37ea0762-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "cinder-fe28086d-47a5-48d6-8748-763e37ea0762-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:08 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Acquiring lock "cinder-quobyte-fe28086d-47a5-48d6-8748-763e37ea0762" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" returned: 0 in 0.526s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446648053',display_name='tempest-VolumesGetTest-Volume-667352129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3f541b-02bf-4c78-a071-846e0a4b25f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:08Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Creating volume 1d3f541b-02bf-4c78-a071-846e0a4b25f9 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:08 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaf1920-75ea-4e96-be3f-c81ca802ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 1073741824
Apr 09 13:37:08 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04adcbd1-7d2a-4e96-804e-22bf38a0563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "cinder-quobyte-fe28086d-47a5-48d6-8748-763e37ea0762" acquired by "delete_volume" :: waited 0.057s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Volume volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e (ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e): created successfully
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04adcbd1-7d2a-4e96-804e-22bf38a0563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (3ed2b052-2343-4140-ad90-b29adf9416bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc7fbf3-4896-472a-baf5-3dbec8928209]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:08 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3601359e-faef-426e-87e8-dcb18b7124d7 tempest-VolumesListTestJSON-1940474890 None] Created volume successfully.
Apr 09 13:37:09 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762
Apr 09 13:37:09 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:09 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Deleted volume successfully.
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47dd6707-e38f-40e3-a0f0-cdd68fc1d853 tempest-VolumesCloneTest-2092525360 None] Lock "cinder-13b3f68e-6d6b-432d-ab8f-977e95d71af3-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:09 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 1073741824" returned: 0 in 0.509s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:09 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9
Apr 09 13:37:09 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:09 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762" returned: 0 in 0.507s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:09 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762
Apr 09 13:37:09 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:09 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9" returned: 0 in 0.531s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cd2466-1810-4631-924e-6beb4384a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101f5e38-1e1c-4c4d-9df7-1d2944681b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Volume volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 (1d3f541b-02bf-4c78-a071-846e0a4b25f9): created successfully
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101f5e38-1e1c-4c4d-9df7-1d2944681b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (fe001218-1bcd-4de7-b5bf-225b175b7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:10 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-86d22e03-cc9b-49dc-a3e0-4d79f56a236f tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fe28086d-47a5-48d6-8748-763e37ea0762" returned: 0 in 0.564s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (6cba4789-79e0-40bc-83bf-082155c83a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58c84a7-2b78-410e-9840-aed6872089b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58c84a7-2b78-410e-9840-aed6872089b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1549333985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42026d8f-833e-41a7-b84d-79b5a81b8aff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:10Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35a9a0e-c44c-4d51-b700-4590e955c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35a9a0e-c44c-4d51-b700-4590e955c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcaade-6400-4de8-bfb9-c22711f8f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcaade-6400-4de8-bfb9-c22711f8f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42026d8f-833e-41a7-b84d-79b5a81b8aff', 'volume_name': 'volume-42026d8f-833e-41a7-b84d-79b5a81b8aff', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031113e2-dc4b-45a4-b0de-8ca68e24d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031113e2-dc4b-45a4-b0de-8ca68e24d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daab84cd-186b-4df0-9e34-38a99b355243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Volume 42026d8f-833e-41a7-b84d-79b5a81b8aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42026d8f-833e-41a7-b84d-79b5a81b8aff', 'volume_size': 1}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1549333985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42026d8f-833e-41a7-b84d-79b5a81b8aff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:10Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Creating volume 42026d8f-833e-41a7-b84d-79b5a81b8aff {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:10 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "cinder-quobyte-fe28086d-47a5-48d6-8748-763e37ea0762" released by "delete_volume" :: held 1.203s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:10 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff 1073741824
Apr 09 13:37:10 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Created reservations ['35ca46dd-2cea-449c-96fc-57607b4f66f8', '85260cb6-aa84-4248-8583-9ede3faaa04e', 'edbb4f80-a901-46ec-b560-486cc12cd4f2', '952ba060-68fd-4252-a734-54810ee3b843'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:10 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:10 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:10 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff 1073741824" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:10 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Deleted volume successfully.
Apr 09 13:37:10 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff
Apr 09 13:37:10 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-95be5d2d-f23c-485a-b9c3-27f9bfae9495 tempest-VolumeQuotasNegativeTestJSON-629996412 None] Lock "cinder-fe28086d-47a5-48d6-8748-763e37ea0762-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-1d3f541b-02bf-4c78-a071-846e0a4b25f9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "cinder-1d3f541b-02bf-4c78-a071-846e0a4b25f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-1d3f541b-02bf-4c78-a071-846e0a4b25f9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-1d3f541b-02bf-4c78-a071-846e0a4b25f9" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3682a9-4881-4023-85ba-37f55baba323]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:10 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9
Apr 09 13:37:10 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:11 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daab84cd-186b-4df0-9e34-38a99b355243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42026d8f-833e-41a7-b84d-79b5a81b8aff', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2610744c-83df-42be-8c39-846e4ded66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Volume volume-42026d8f-833e-41a7-b84d-79b5a81b8aff (42026d8f-833e-41a7-b84d-79b5a81b8aff): created successfully
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2610744c-83df-42be-8c39-846e4ded66c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (6cba4789-79e0-40bc-83bf-082155c83a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:11 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-24a5ea54-719b-434b-a7a7-b77f26a9987a tempest-VolumesListTestJSON-1940474890 None] Created volume successfully.
Apr 09 13:37:11 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:11 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9
Apr 09 13:37:11 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Flow 'volume_create_manager' (108c8827-2899-4af9-8b2e-b1c211f700df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72821f68-6a3e-4a68-83dd-847a30f899f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72821f68-6a3e-4a68-83dd-847a30f899f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-780900667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c680153f-6147-46d5-9f39-01a7e068554a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f16cf5f6d4e289b56a8ec77977fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:11Z,use_quota=True,user_id='4021d77a90534b6fac3e05f5f5ba93c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e8c802-7b63-4d09-94ac-47ae5601dfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e8c802-7b63-4d09-94ac-47ae5601dfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13820dc6-911b-481e-bb0a-f81174d729a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13820dc6-911b-481e-bb0a-f81174d729a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c680153f-6147-46d5-9f39-01a7e068554a', 'volume_name': 'volume-c680153f-6147-46d5-9f39-01a7e068554a', 'volume_size': 2}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05bfe08-9507-4b3f-870e-bf8eef93fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05bfe08-9507-4b3f-870e-bf8eef93fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f9d418-f572-4aa9-b7ce-938a40688664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:11 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Volume c680153f-6147-46d5-9f39-01a7e068554a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c680153f-6147-46d5-9f39-01a7e068554a', 'volume_size': 2}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-780900667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c680153f-6147-46d5-9f39-01a7e068554a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f16cf5f6d4e289b56a8ec77977fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:11Z,use_quota=True,user_id='4021d77a90534b6fac3e05f5f5ba93c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Creating volume c680153f-6147-46d5-9f39-01a7e068554a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:11 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a 2147483648 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:11 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a 2147483648
Apr 09 13:37:11 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:11 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1d3f541b-02bf-4c78-a071-846e0a4b25f9" returned: 0 in 0.550s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-1d3f541b-02bf-4c78-a071-846e0a4b25f9" released by "delete_volume" :: held 1.147s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Created reservations ['82e4cd4e-1d0a-463a-849f-441ddabc3c91', '9d82a9b5-8914-462c-b828-fb4aee5ec5c2', '8a56f0cc-f811-426d-8ca7-1ff05ff380c4', 'f659da84-5608-4c16-ab2a-a89a840ea613'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:12 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:12 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:12 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a 2147483648" returned: 0 in 0.607s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:12 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a
Apr 09 13:37:12 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (a3368eaa-1951-4821-9363-31e28a08038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ba8988-5647-4264-a0c4-81bd8c292d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ba8988-5647-4264-a0c4-81bd8c292d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170109955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84c56bf-300c-4432-b6e6-de5bdbfa05a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:12Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9595407e-cbd1-425a-b185-41ad1254d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9595407e-cbd1-425a-b185-41ad1254d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3488d62-b351-4f13-83e2-7bf3e99a449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3488d62-b351-4f13-83e2-7bf3e99a449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84c56bf-300c-4432-b6e6-de5bdbfa05a0', 'volume_name': 'volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b60b1f4-ec19-4436-aa2e-651b82300834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b60b1f4-ec19-4436-aa2e-651b82300834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76327ed5-9cb5-47d2-aa3a-d1a70c7b57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Volume a84c56bf-300c-4432-b6e6-de5bdbfa05a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0', 'volume_size': 1}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:12 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.518s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-daa12962-810f-486d-b8f8-d81e47ea6606 tempest-VolumesGetTest-18509421 None] Lock "cinder-1d3f541b-02bf-4c78-a071-846e0a4b25f9-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:12 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a" returned: 0 in 0.541s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170109955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84c56bf-300c-4432-b6e6-de5bdbfa05a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786e29250b20471ca94cb8950533f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:12Z,use_quota=True,user_id='e1fe1e45d869400890ce3c69f32902fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Creating volume a84c56bf-300c-4432-b6e6-de5bdbfa05a0 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:12 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f9d418-f572-4aa9-b7ce-938a40688664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c680153f-6147-46d5-9f39-01a7e068554a', 'volume_size': 2}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf16e7-cae5-44d0-884d-acd92830f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:12 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 1073741824
Apr 09 13:37:12 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:12 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Volume volume-c680153f-6147-46d5-9f39-01a7e068554a (c680153f-6147-46d5-9f39-01a7e068554a): created successfully
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf16e7-cae5-44d0-884d-acd92830f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Flow 'volume_create_manager' (108c8827-2899-4af9-8b2e-b1c211f700df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f46352f7-54aa-434e-9efa-2faabc09b6bf tempest-VolumesCloneNegativeTest-403621696 None] Created volume successfully.
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-d01aca99-40f7-4e4e-88a7-9b013545ae8c-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "cinder-d01aca99-40f7-4e4e-88a7-9b013545ae8c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-d01aca99-40f7-4e4e-88a7-9b013545ae8c" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-d01aca99-40f7-4e4e-88a7-9b013545ae8c" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2142cdc2-1bde-43ed-8e16-ad14a8f551a3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:13 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c
Apr 09 13:37:13 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:13 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 1073741824" returned: 0 in 0.628s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:13 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0
Apr 09 13:37:13 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:13 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c" returned: 0 in 0.603s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:13 devstack sudo[88232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c
Apr 09 13:37:13 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Acquiring lock "cinder-c680153f-6147-46d5-9f39-01a7e068554a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "cinder-c680153f-6147-46d5-9f39-01a7e068554a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Acquiring lock "cinder-quobyte-c680153f-6147-46d5-9f39-01a7e068554a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "cinder-quobyte-c680153f-6147-46d5-9f39-01a7e068554a" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d763bbf-04b8-4ad5-bee6-6f3ef10bdbd4]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:13 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" returned: 0 in 0.521s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76327ed5-9cb5-47d2-aa3a-d1a70c7b57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:13 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a
Apr 09 13:37:13 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f126b4-13a7-4859-8454-b192d2f7a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:13 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Volume volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 (a84c56bf-300c-4432-b6e6-de5bdbfa05a0): created successfully
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f126b4-13a7-4859-8454-b192d2f7a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Flow 'volume_create_manager' (a3368eaa-1951-4821-9363-31e28a08038c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-131628f6-cf13-48c4-82f2-0d1d6358a019 tempest-VolumesListTestJSON-1940474890 None] Created volume successfully.
Apr 09 13:37:14 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d01aca99-40f7-4e4e-88a7-9b013545ae8c" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-d01aca99-40f7-4e4e-88a7-9b013545ae8c" released by "delete_volume" :: held 1.147s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Created reservations ['2a9a142b-c306-41f0-9a16-d8c5d930cbd9', '475d0fbe-0e6e-483c-a467-ea93b5de3d36', '675e4466-d195-4bea-bcfa-3ccaa319e9ca', '40e42d8e-634b-4b95-8150-dd8b6cbd6186'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:14 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:14 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:14 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a" returned: 0 in 0.566s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:14 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a
Apr 09 13:37:14 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Flow 'volume_create_manager' (14f6b988-17e4-4abd-8b79-032453341c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99568d71-4e41-4f80-b43a-919b4ea35716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99568d71-4e41-4f80-b43a-919b4ea35716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-690140565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57c164e-b9ba-4b5f-a4ca-61d6347f058d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f4a625ec2647c1bc9467db5ce11e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:14Z,use_quota=True,user_id='a070823a6aec45f4a707f9476350611a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b034a6b2-7769-46ab-991d-ca2659771eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b034a6b2-7769-46ab-991d-ca2659771eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21999c4-e7d8-41ad-81d6-6ba5fc073686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21999c4-e7d8-41ad-81d6-6ba5fc073686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57c164e-b9ba-4b5f-a4ca-61d6347f058d', 'volume_name': 'volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc83d9-289f-4132-830f-d593556ffcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc83d9-289f-4132-830f-d593556ffcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e990f-fb62-4860-b14d-d0e3f4b4437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:14 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Volume d57c164e-b9ba-4b5f-a4ca-61d6347f058d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d', 'volume_size': 1}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-690140565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57c164e-b9ba-4b5f-a4ca-61d6347f058d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f4a625ec2647c1bc9467db5ce11e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:14Z,use_quota=True,user_id='a070823a6aec45f4a707f9476350611a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Creating volume d57c164e-b9ba-4b5f-a4ca-61d6347f058d {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:14 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:14 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d 1073741824
Apr 09 13:37:14 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:14 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:14 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-35ed8cad-5736-4786-b2ca-391803aaf95b tempest-VolumesGetTest-18509421 None] Lock "cinder-d01aca99-40f7-4e4e-88a7-9b013545ae8c-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:14 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c680153f-6147-46d5-9f39-01a7e068554a" returned: 0 in 0.532s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "cinder-quobyte-c680153f-6147-46d5-9f39-01a7e068554a" released by "delete_volume" :: held 1.120s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Created reservations ['25367426-8f65-4f09-8bc5-ccd28585c0b2', '497df62d-5123-4c52-9160-7c4fcaee7f78', 'cf81c5e1-40d8-447d-9174-fc5c315198eb', 'de652959-dec1-4572-9b57-1e3bf1d77c6e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:15 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:15 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:15 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d 1073741824" returned: 0 in 0.576s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:15 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d
Apr 09 13:37:15 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:15 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:15 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Deleted volume successfully.
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (8c17c2cb-9f3a-49c3-a18d-53349c6a9f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d84b78-9db0-4e8a-a6a6-7f239959b15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d84b78-9db0-4e8a-a6a6-7f239959b15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304485655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0727e597-e82d-454b-a613-0a7f1747663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:16Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb3c9f2-a872-404c-ad2f-f150d3f597d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb3c9f2-a872-404c-ad2f-f150d3f597d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e0dfc1-d861-4571-877e-8eaee9f9d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e0dfc1-d861-4571-877e-8eaee9f9d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0727e597-e82d-454b-a613-0a7f1747663f', 'volume_name': 'volume-0727e597-e82d-454b-a613-0a7f1747663f', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34100ae-f526-4f0e-8730-bcd27333bd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34100ae-f526-4f0e-8730-bcd27333bd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0344b4e7-3ea4-413b-875a-178cd6b604f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Volume 0727e597-e82d-454b-a613-0a7f1747663f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0727e597-e82d-454b-a613-0a7f1747663f', 'volume_size': 1}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-d2ca11c1-bf97-45f6-bea8-3fb68039b7bb tempest-VolumesCloneNegativeTest-403621696 None] Lock "cinder-c680153f-6147-46d5-9f39-01a7e068554a-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:15 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304485655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0727e597-e82d-454b-a613-0a7f1747663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:16Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Creating volume 0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:15 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e990f-fb62-4860-b14d-d0e3f4b4437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a8797a-3aa9-4e5d-aa15-b06821630fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:15 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f 1073741824
Apr 09 13:37:15 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:15 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Volume volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d (d57c164e-b9ba-4b5f-a4ca-61d6347f058d): created successfully
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a8797a-3aa9-4e5d-aa15-b06821630fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Flow 'volume_create_manager' (14f6b988-17e4-4abd-8b79-032453341c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:15 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f77ba0e2-e64e-470c-b4cb-a48918ba5f4e tempest-VolumesServicesTestJSON-1290541186 None] Created volume successfully.
Apr 09 13:37:16 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f 1073741824" returned: 0 in 0.556s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:16 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:16 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-a84c56bf-300c-4432-b6e6-de5bdbfa05a0-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-a84c56bf-300c-4432-b6e6-de5bdbfa05a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-quobyte-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a629825-1052-4786-9525-4d2fe37a0e39]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:16 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0
Apr 09 13:37:16 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:16 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.503s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0344b4e7-3ea4-413b-875a-178cd6b604f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0727e597-e82d-454b-a613-0a7f1747663f', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3a55dd-8041-49e2-84d8-bef6110a1cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:16 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Volume volume-0727e597-e82d-454b-a613-0a7f1747663f (0727e597-e82d-454b-a613-0a7f1747663f): created successfully
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3a55dd-8041-49e2-84d8-bef6110a1cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (8c17c2cb-9f3a-49c3-a18d-53349c6a9f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-278f9bff-4cd6-4570-a79e-b7caae19fdbf tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Acquiring lock "cinder-d57c164e-b9ba-4b5f-a4ca-61d6347f058d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "cinder-d57c164e-b9ba-4b5f-a4ca-61d6347f058d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Acquiring lock "cinder-quobyte-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "cinder-quobyte-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4794b9-13e9-430b-aacd-ac4210bf7797]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:16 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d
Apr 09 13:37:16 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:17 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" returned: 0 in 0.613s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:17 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0
Apr 09 13:37:17 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:17 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" returned: 0 in 0.531s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:17 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d
Apr 09 13:37:17 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:17 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" returned: 0 in 0.512s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-a84c56bf-300c-4432-b6e6-de5bdbfa05a0" released by "delete_volume" :: held 1.147s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Created reservations ['a4f2fcc4-8428-42c5-b8ff-8a48ea2a3f6b', '0cdbd09b-a0e8-4851-857b-64bd0b1dac49', '3082db3d-83a3-49a9-9cff-6a89fb31a151', '35f6b8f3-153d-47a0-bfda-bdfa869ab144'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Flow 'volume_create_manager' (5b96a742-f64d-4ff1-a0c6-838dd5d021f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d691a-f4c8-4654-9798-e68cf83fc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d691a-f4c8-4654-9798-e68cf83fc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-183523151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbdcc8e-2119-4d77-9dc4-25e3402158ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1dd7166d6b4c5dbed959f2dadc4cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:18Z,use_quota=True,user_id='bf4e56fb488347b8894a99ae2d2d3c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804ca0d0-5bd0-4927-b295-5a374994c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804ca0d0-5bd0-4927-b295-5a374994c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a2dce9-3954-44e4-abfc-d26aecdafad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a2dce9-3954-44e4-abfc-d26aecdafad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbdcc8e-2119-4d77-9dc4-25e3402158ef', 'volume_name': 'volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3343819-f905-4e87-99e0-fa367a7fb047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3343819-f905-4e87-99e0-fa367a7fb047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014c1896-062e-4bc0-8fed-6259cf20dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:17 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Volume 6cbdcc8e-2119-4d77-9dc4-25e3402158ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef', 'volume_size': 1}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-183523151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbdcc8e-2119-4d77-9dc4-25e3402158ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1dd7166d6b4c5dbed959f2dadc4cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:18Z,use_quota=True,user_id='bf4e56fb488347b8894a99ae2d2d3c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Creating volume 6cbdcc8e-2119-4d77-9dc4-25e3402158ef {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:17 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:17 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef 1073741824
Apr 09 13:37:17 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:18 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" returned: 0 in 0.573s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:18 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:18 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (ed57a5ab-ee7e-4c86-8804-8a776b8bb960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6036589-c060-4d4f-aaa2-e737b49d8af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "cinder-quobyte-d57c164e-b9ba-4b5f-a4ca-61d6347f058d" released by "delete_volume" :: held 1.183s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6036589-c060-4d4f-aaa2-e737b49d8af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-996801301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c58b255-7b35-4d89-a7eb-a9d3628cbeb9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0727e597-e82d-454b-a613-0a7f1747663f,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:18Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd33c6d5-06d9-41bd-a236-ff2f853b9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd33c6d5-06d9-41bd-a236-ff2f853b9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae2fd3-60d1-4f75-94b0-b3f15e08de38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae2fd3-60d1-4f75-94b0-b3f15e08de38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2c58b255-7b35-4d89-a7eb-a9d3628cbeb9', 'volume_name': 'volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9', 'volume_size': 1, 'source_volid': '0727e597-e82d-454b-a613-0a7f1747663f', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280189e6-b5ae-4263-aee6-2b94e9cb4212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280189e6-b5ae-4263-aee6-2b94e9cb4212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd992ec-1b7b-4a99-9e2a-99fdec825c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Volume 2c58b255-7b35-4d89-a7eb-a9d3628cbeb9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9', 'volume_size': 1, 'source_volid': '0727e597-e82d-454b-a613-0a7f1747663f', 'source_volstatus': 'available'}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Created reservations ['be43d375-816b-4c11-8e38-e658f94fb20c', '7ec8e930-a12a-488f-852a-5647e7823e23', 'a8576465-dbe9-42e7-8441-da8a8c2015f3', '3595c4ae-5ae7-417e-be62-cdff9112def8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:18 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:18 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:18 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.456s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:18 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Deleted volume successfully.
Apr 09 13:37:18 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef 1073741824" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2d78b771-1266-43a1-9c35-bc040e26ca3d tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-a84c56bf-300c-4432-b6e6-de5bdbfa05a0-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:18 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef
Apr 09 13:37:18 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:18 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:18 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Deleted volume successfully.
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-20922a84-4ce7-4003-a6a4-7a7f785d6def tempest-VolumesServicesTestJSON-1290541186 None] Lock "cinder-d57c164e-b9ba-4b5f-a4ca-61d6347f058d-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-42026d8f-833e-41a7-b84d-79b5a81b8aff-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-42026d8f-833e-41a7-b84d-79b5a81b8aff-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-quobyte-42026d8f-833e-41a7-b84d-79b5a81b8aff" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-42026d8f-833e-41a7-b84d-79b5a81b8aff" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:18 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" returned: 0 in 0.451s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.807s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:18 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Cloning volume 0727e597-e82d-454b-a613-0a7f1747663f to volume 2c58b255-7b35-4d89-a7eb-a9d3628cbeb9
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[926be3db-44ea-4ebb-a964-86c1f43331c3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014c1896-062e-4bc0-8fed-6259cf20dea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b85677-45da-44d9-9b0e-b035aab15de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:18 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Volume volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef (6cbdcc8e-2119-4d77-9dc4-25e3402158ef): created successfully
Apr 09 13:37:18 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b85677-45da-44d9-9b0e-b035aab15de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Flow 'volume_create_manager' (5b96a742-f64d-4ff1-a0c6-838dd5d021f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-975a90fb-9793-470f-b051-3ec8e9ba06e9 tempest-VolumesNegativeTest-410114958 None] Created volume successfully.
Apr 09 13:37:19 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff
Apr 09 13:37:19 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Creating offline snapshot 11534436-be58-4bf7-8cca-9df01cdbba08 of volume 0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbf874-619d-411a-a1b4-2a9fd8b967d8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:19 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:19 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:19 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:19 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff
Apr 09 13:37:19 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:19 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.532s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:19 devstack sudo[88310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 1G
Apr 09 13:37:19 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:20 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-42026d8f-833e-41a7-b84d-79b5a81b8aff" returned: 0 in 0.582s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-42026d8f-833e-41a7-b84d-79b5a81b8aff" released by "delete_volume" :: held 1.140s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:20 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 1G" returned: 0 in 0.533s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0727e597-e82d-454b-a613-0a7f1747663f -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Created reservations ['db8f1a17-d097-4ba0-a756-739826a4b00a', 'a4069f41-e03f-45b7-8771-04ea801f6a66', 'f446e21a-00ff-448a-9f21-3efaf1546c5f', '639b7049-a056-435a-842a-63b1752780bf'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:20 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0727e597-e82d-454b-a613-0a7f1747663f -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:20 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:20 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:20 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:20 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0727e597-e82d-454b-a613-0a7f1747663f -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.662s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:20 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 is being set with open permissions: ugo+rw
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:20 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.596s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:20 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Deleted volume successfully.
Apr 09 13:37:20 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:20 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6172f48e-208e-45c7-bcb5-28ffb6e8ecb1 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-42026d8f-833e-41a7-b84d-79b5a81b8aff-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "cinder-quobyte-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af65a94-3bd7-4cea-a2e5-b5d4ccdfef83]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:21 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.521s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:21 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e
Apr 09 13:37:21 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:21 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info
Apr 09 13:37:21 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:21 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:21 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info is being set with open permissions: ugo+rw
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:21 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" returned: 0 in 0.591s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:21 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info
Apr 09 13:37:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:21 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:21 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e
Apr 09 13:37:21 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:22 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" returned: 0 in 0.436s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-quobyte-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e" released by "delete_volume" :: held 1.051s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Created reservations ['e20181fd-5dfb-49ba-8888-12ec58639337', 'a2f149ba-67f5-4225-8580-3f1314821710', 'f3559e75-7601-4903-a085-cfa14932fefa', '6c572829-4a9b-466e-8436-6405544f156c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:22 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.info" returned: 0 in 0.526s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] snapshot: 11534436-be58-4bf7-8cca-9df01cdbba08, volume: 2c58b255-7b35-4d89-a7eb-a9d3628cbeb9,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f6a87e-d228-4cfa-9281-c31c81d659d8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:22 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:22 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:22 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:22 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:22 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.572s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0727e597-e82d-454b-a613-0a7f1747663f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd1388-30df-4617-91cb-e3a99a6680c0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:22 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.559s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:22 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Deleted volume successfully.
Apr 09 13:37:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2ed5ffbe-181c-4a5a-bad7-1d4cf7fe5eb0 tempest-VolumesListTestJSON-1940474890 None] Lock "cinder-ccb8d0a7-5d16-44c7-8bdf-41daf0432b3e-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:23 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:23 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:23 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:23 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:37:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:23 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9
Apr 09 13:37:23 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:26 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" returned: 0 in 2.532s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04cfe6c-71b8-40b3-b29f-1a907247c3fa]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:26 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:26 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e79c479d-2021-4f4a-9eb1-b398ad42e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d86afd-2793-4990-a174-eb5a7d14157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d86afd-2793-4990-a174-eb5a7d14157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364919751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5db290-6a31-4a92-b52a-94f30d04e744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:27Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f3870-cc48-44f8-9396-4c40c3edf3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f3870-cc48-44f8-9396-4c40c3edf3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c288c2a-cba0-4b98-a4ef-111c8a596c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c288c2a-cba0-4b98-a4ef-111c8a596c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5db290-6a31-4a92-b52a-94f30d04e744', 'volume_name': 'volume-1c5db290-6a31-4a92-b52a-94f30d04e744', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d82f88-9044-4be4-af29-f707d3d30cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d82f88-9044-4be4-af29-f707d3d30cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587b1bf7-c1e8-4d76-8f64-af27978bcbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume 1c5db290-6a31-4a92-b52a-94f30d04e744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5db290-6a31-4a92-b52a-94f30d04e744', 'volume_size': 1}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:26 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.896s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:37:26 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Converted 1024.00 MB image at 404.07 MB/s
Apr 09 13:37:26 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 is being set with open permissions: ugo+rw
Apr 09 13:37:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:26 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9
Apr 09 13:37:26 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:27 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" released by "_copy_volume_from_snapshot" :: held 5.142s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-11534436-be58-4bf7-8cca-9df01cdbba08" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-11534436-be58-4bf7-8cca-9df01cdbba08" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Deleting offline snapshot 11534436-be58-4bf7-8cca-9df01cdbba08 of volume 0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] snapshot_file for this snap is: volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd0375-453b-4020-88e0-9f1c7342948c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:27 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:27 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:28 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.670s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0727e597-e82d-454b-a613-0a7f1747663f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea8cc5d-d801-435c-98b7-2b3a7d49e805]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:28 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:28 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:28 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.587s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:28 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:28 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Flow 'volume_create_manager' (aaf414b4-c216-44d5-90df-ffefe03443d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d31266-ccae-4a79-9cc0-77fce23e98f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d31266-ccae-4a79-9cc0-77fce23e98f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-63492862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2581dcfc-aeda-4d6c-b15c-b288ae7f52a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457039836b5c4cdfbb58a244dfdbc110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:29Z,use_quota=True,user_id='16904d32a16d415caba1d47f0d676e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77aec66-d09e-46f2-a569-d8f2f22a4ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77aec66-d09e-46f2-a569-d8f2f22a4ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeec84cb-dd93-4a37-afdc-b46354fe72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeec84cb-dd93-4a37-afdc-b46354fe72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2581dcfc-aeda-4d6c-b15c-b288ae7f52a7', 'volume_name': 'volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c0ae11-c9a3-4909-9ba4-7e075fa65f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c0ae11-c9a3-4909-9ba4-7e075fa65f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ff17f7-ee07-4b6c-ba0c-cf3361b100a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:28 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Volume 2581dcfc-aeda-4d6c-b15c-b288ae7f52a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7', 'volume_size': 1}
Apr 09 13:37:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:29 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:29 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08
Apr 09 13:37:29 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:29 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f.11534436-be58-4bf7-8cca-9df01cdbba08" returned: 0 in 0.465s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-11534436-be58-4bf7-8cca-9df01cdbba08" released by "_delete_snapshot" :: held 2.265s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.872s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364919751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5db290-6a31-4a92-b52a-94f30d04e744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:27Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume 1c5db290-6a31-4a92-b52a-94f30d04e744 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:29 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd992ec-1b7b-4a99-9e2a-99fdec825c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9', 'volume_size': 1, 'source_volid': '0727e597-e82d-454b-a613-0a7f1747663f', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:29 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 1073741824
Apr 09 13:37:29 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f87e280-6ab1-45c9-a4df-f0e18ca86f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:29 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Volume volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 (2c58b255-7b35-4d89-a7eb-a9d3628cbeb9): created successfully
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f87e280-6ab1-45c9-a4df-f0e18ca86f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (ed57a5ab-ee7e-4c86-8804-8a776b8bb960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:29 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-88136284-9642-467b-88fa-a92843207af3 tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:30 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 1073741824" returned: 0 in 0.586s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:30 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744
Apr 09 13:37:30 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:30 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-63492862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2581dcfc-aeda-4d6c-b15c-b288ae7f52a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457039836b5c4cdfbb58a244dfdbc110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:29Z,use_quota=True,user_id='16904d32a16d415caba1d47f0d676e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Creating volume 2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:30 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587b1bf7-c1e8-4d76-8f64-af27978bcbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5db290-6a31-4a92-b52a-94f30d04e744', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:30 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 1073741824
Apr 09 13:37:30 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f97c460-2fd6-4b52-8f2c-d67e767b863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:30 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-1c5db290-6a31-4a92-b52a-94f30d04e744 (1c5db290-6a31-4a92-b52a-94f30d04e744): created successfully
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f97c460-2fd6-4b52-8f2c-d67e767b863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e79c479d-2021-4f4a-9eb1-b398ad42e535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-78c553bc-a9d7-4f31-946d-0e781432280d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (b611bdcf-1464-4dc2-a18b-5153510154d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100934a5-39a8-4e40-a303-03cc73852193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100934a5-39a8-4e40-a303-03cc73852193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-318987976',display_name='tempest-VolumesGetTest-Volume-421860876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cc204d-1acc-474d-baeb-c0d1f26923fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:31Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087995a6-bd33-4c63-9876-a63c1b00366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087995a6-bd33-4c63-9876-a63c1b00366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472b201-ec82-40a1-8c87-4bf6978eac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472b201-ec82-40a1-8c87-4bf6978eac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cc204d-1acc-474d-baeb-c0d1f26923fd', 'volume_name': 'volume-33cc204d-1acc-474d-baeb-c0d1f26923fd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61526fe3-cc2b-49c8-88cc-1d56f2df0d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61526fe3-cc2b-49c8-88cc-1d56f2df0d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbadb8d-ef2a-40a0-bbd2-bfa9551ad4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Volume 33cc204d-1acc-474d-baeb-c0d1f26923fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cc204d-1acc-474d-baeb-c0d1f26923fd', 'volume_size': 1}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (ec52f1ed-8692-415b-86d4-ba60fd1f93da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb62aa-d68d-4bac-8d41-d8bd0d453d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb62aa-d68d-4bac-8d41-d8bd0d453d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47386549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e90174-97eb-417d-9e9a-5eac6642caaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:31Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d526f46-b29a-46cc-b494-a5ffce62d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d526f46-b29a-46cc-b494-a5ffce62d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb2b086-fad8-4508-8d83-116fbe4cebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb2b086-fad8-4508-8d83-116fbe4cebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e90174-97eb-417d-9e9a-5eac6642caaa', 'volume_name': 'volume-58e90174-97eb-417d-9e9a-5eac6642caaa', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f159e-7358-4ddd-9c2b-b9d83eee77aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f159e-7358-4ddd-9c2b-b9d83eee77aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66fe9bf-073f-46c1-8b92-88e887c2f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume 58e90174-97eb-417d-9e9a-5eac6642caaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e90174-97eb-417d-9e9a-5eac6642caaa', 'volume_size': 1}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:31 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 1073741824" returned: 0 in 0.621s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:31 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7
Apr 09 13:37:31 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e3387c58-1f8c-4a08-8874-bc475d0da5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c1f85d-dad6-4e66-bf5c-9da4e571bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c1f85d-dad6-4e66-bf5c-9da4e571bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346554830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832ec2a0-6472-427f-a7e6-1264b851fd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc19d1-9199-46b5-b716-a57cbc7fd11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc19d1-9199-46b5-b716-a57cbc7fd11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954fba5f-cce8-4665-8bb2-b59c0facbda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954fba5f-cce8-4665-8bb2-b59c0facbda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832ec2a0-6472-427f-a7e6-1264b851fd96', 'volume_name': 'volume-832ec2a0-6472-427f-a7e6-1264b851fd96', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebd290d-d39e-4917-ae13-90ef7d4e1771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebd290d-d39e-4917-ae13-90ef7d4e1771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7717daa0-578e-4867-8a2b-1985a21c1c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume 832ec2a0-6472-427f-a7e6-1264b851fd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832ec2a0-6472-427f-a7e6-1264b851fd96', 'volume_size': 1}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e9cb9cdf-125a-457c-a031-e3d227b57c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ed2e0f-ba03-47e0-bf60-31c58e3ce781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ed2e0f-ba03-47e0-bf60-31c58e3ce781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581554290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5aaa9a-c944-4017-99d0-8e1270568bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15eef34-a631-4850-91ba-dc35da97a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15eef34-a631-4850-91ba-dc35da97a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bb9dc4-51ee-40cb-9a0b-e5704623f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bb9dc4-51ee-40cb-9a0b-e5704623f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5aaa9a-c944-4017-99d0-8e1270568bba', 'volume_name': 'volume-bb5aaa9a-c944-4017-99d0-8e1270568bba', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410c3422-8a3f-413d-b3c9-fa58643b8cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410c3422-8a3f-413d-b3c9-fa58643b8cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbe1bf6-654b-41bf-8eb0-e105eef4e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume bb5aaa9a-c944-4017-99d0-8e1270568bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5aaa9a-c944-4017-99d0-8e1270568bba', 'volume_size': 1}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (84a9d563-ac6f-41b0-9aa1-3c7fc0c2425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160099e-1ade-4f6e-8aff-7e9236e4d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160099e-1ade-4f6e-8aff-7e9236e4d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063066273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18795888-dfbc-4619-8437-6b9c9486847a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5014de-bcdb-429a-aac4-4b14b56bda8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5014de-bcdb-429a-aac4-4b14b56bda8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323c2501-a8f8-4ea4-b4e8-c12eef2a5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323c2501-a8f8-4ea4-b4e8-c12eef2a5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18795888-dfbc-4619-8437-6b9c9486847a', 'volume_name': 'volume-18795888-dfbc-4619-8437-6b9c9486847a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2acc9-c3e4-446b-8f91-2bf00f9525ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2acc9-c3e4-446b-8f91-2bf00f9525ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e337956-2a96-4678-b25b-1bc489341175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume 18795888-dfbc-4619-8437-6b9c9486847a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18795888-dfbc-4619-8437-6b9c9486847a', 'volume_size': 1}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-318987976',display_name='tempest-VolumesGetTest-Volume-421860876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cc204d-1acc-474d-baeb-c0d1f26923fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:31Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Creating volume 33cc204d-1acc-474d-baeb-c0d1f26923fd {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ff17f7-ee07-4b6c-ba0c-cf3361b100a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52f8371-32df-488b-be02-1725a715831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd 1073741824
Apr 09 13:37:32 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Volume volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 (2581dcfc-aeda-4d6c-b15c-b288ae7f52a7): created successfully
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52f8371-32df-488b-be02-1725a715831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Flow 'volume_create_manager' (aaf414b4-c216-44d5-90df-ffefe03443d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a03ec30d-ed3f-409c-a71d-3c48eccb014e tempest-SnapshotMetadataTestJSON-2098162765 None] Created volume successfully.
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (ddd2a274-024d-4ec1-a272-c259e698a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c0f4e0-e4d3-4bb0-818f-bd8e2937f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c0f4e0-e4d3-4bb0-818f-bd8e2937f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967451867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb107bd2-da77-422a-82e7-09a1f80de58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876ed237-fa53-4d28-ae95-0d4969ea1ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876ed237-fa53-4d28-ae95-0d4969ea1ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0ef50e-15fb-4e6c-9eba-4a4f5d98ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0ef50e-15fb-4e6c-9eba-4a4f5d98ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb107bd2-da77-422a-82e7-09a1f80de58e', 'volume_name': 'volume-fb107bd2-da77-422a-82e7-09a1f80de58e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df60d79-cb5d-47e5-898b-34bbacddc57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df60d79-cb5d-47e5-898b-34bbacddc57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf0010-2018-4dd8-b182-78e38047bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume fb107bd2-da77-422a-82e7-09a1f80de58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb107bd2-da77-422a-82e7-09a1f80de58e', 'volume_size': 1}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:32 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd 1073741824" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:32 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd
Apr 09 13:37:32 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:32 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd" returned: 0 in 0.420s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47386549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e90174-97eb-417d-9e9a-5eac6642caaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:31Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume 58e90174-97eb-417d-9e9a-5eac6642caaa {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:32 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbadb8d-ef2a-40a0-bbd2-bfa9551ad4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cc204d-1acc-474d-baeb-c0d1f26923fd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:33 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa 1073741824
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe8331f-3e1f-4b71-968a-c79cb6c3ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:33 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Volume volume-33cc204d-1acc-474d-baeb-c0d1f26923fd (33cc204d-1acc-474d-baeb-c0d1f26923fd): created successfully
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe8331f-3e1f-4b71-968a-c79cb6c3ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (b611bdcf-1464-4dc2-a18b-5153510154d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d7e58746-0ae2-4596-a29b-afbc6ec3b30d tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-33cc204d-1acc-474d-baeb-c0d1f26923fd-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "cinder-33cc204d-1acc-474d-baeb-c0d1f26923fd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-33cc204d-1acc-474d-baeb-c0d1f26923fd" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-33cc204d-1acc-474d-baeb-c0d1f26923fd" acquired by "delete_volume" :: waited 0.023s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f627418-e3ac-48d2-8c99-57ef076b602d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:33 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa 1073741824" returned: 0 in 0.770s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:33 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa
Apr 09 13:37:33 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:33 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd
Apr 09 13:37:33 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:34 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa" returned: 0 in 0.507s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346554830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832ec2a0-6472-427f-a7e6-1264b851fd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume 832ec2a0-6472-427f-a7e6-1264b851fd96 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:34 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66fe9bf-073f-46c1-8b92-88e887c2f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e90174-97eb-417d-9e9a-5eac6642caaa', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b23b74c-e6ac-4c2f-9574-d867cb1f24c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:34 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:34 devstack sudo[88493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 1073741824
Apr 09 13:37:34 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd" returned: 0 in 0.682s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:34 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-58e90174-97eb-417d-9e9a-5eac6642caaa (58e90174-97eb-417d-9e9a-5eac6642caaa): created successfully
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b23b74c-e6ac-4c2f-9574-d867cb1f24c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (ec52f1ed-8692-415b-86d4-ba60fd1f93da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-06ddb811-e3ce-4ece-855b-013c140db779 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:34 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd
Apr 09 13:37:34 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:34 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-33cc204d-1acc-474d-baeb-c0d1f26923fd" returned: 0 in 0.464s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-33cc204d-1acc-474d-baeb-c0d1f26923fd" released by "delete_volume" :: held 1.181s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Created reservations ['879fd4e8-d283-491c-92cf-4ab429d81252', 'e434a806-0152-4281-bd5f-f03f3d766df4', 'df186de2-3c1a-4dd5-9d95-a0426c87428c', '66440e20-9726-4ee8-bcad-48071d2c83d3'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:34 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 1073741824" returned: 0 in 0.630s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:34 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:34 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:35 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96
Apr 09 13:37:35 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:35 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96" returned: 0 in 0.512s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.661s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581554290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5aaa9a-c944-4017-99d0-8e1270568bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume bb5aaa9a-c944-4017-99d0-8e1270568bba {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:35 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7717daa0-578e-4867-8a2b-1985a21c1c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832ec2a0-6472-427f-a7e6-1264b851fd96', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:35 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba 1073741824
Apr 09 13:37:35 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7a223-57d0-459d-9f75-c3b67b748869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:35 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.612s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:35 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-832ec2a0-6472-427f-a7e6-1264b851fd96 (832ec2a0-6472-427f-a7e6-1264b851fd96): created successfully
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7a223-57d0-459d-9f75-c3b67b748869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e3387c58-1f8c-4a08-8874-bc475d0da5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a1149353-b6d6-4712-91b0-8b569a37818d tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2037877b-d60f-49e3-ae9c-f320d582f73f tempest-VolumesGetTest-18509421 None] Lock "cinder-33cc204d-1acc-474d-baeb-c0d1f26923fd-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "cinder-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" acquired by "delete_volume" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173d4ba-f36c-42b5-8bb5-6db121ce3971]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:36 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9
Apr 09 13:37:36 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:36 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba 1073741824" returned: 0 in 0.606s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:36 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba
Apr 09 13:37:36 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:36 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" returned: 0 in 0.502s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:36 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9
Apr 09 13:37:36 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:36 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba" returned: 0 in 0.539s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.673s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063066273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18795888-dfbc-4619-8437-6b9c9486847a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume 18795888-dfbc-4619-8437-6b9c9486847a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:36 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbe1bf6-654b-41bf-8eb0-e105eef4e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5aaa9a-c944-4017-99d0-8e1270568bba', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd0cfaa-f923-4587-bf0c-ac7ed1fdf80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:36 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a 1073741824
Apr 09 13:37:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-bb5aaa9a-c944-4017-99d0-8e1270568bba (bb5aaa9a-c944-4017-99d0-8e1270568bba): created successfully
Apr 09 13:37:36 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd0cfaa-f923-4587-bf0c-ac7ed1fdf80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (e9cb9cdf-125a-457c-a031-e3d227b57c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-75dc2521-5db5-4c33-a405-6234f5b97817 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:36 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" returned: 0 in 0.512s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9" released by "delete_volume" :: held 1.065s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Created reservations ['c998eee2-75fb-4376-8e6c-1e1e499556fd', 'da07f27f-0750-456e-9f7b-5fb7cf9dfbd6', '652604ce-72bb-4fb8-ac49-81f67a942965', '425e1070-95cb-4274-a49b-ee217a560bf1'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:37 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:37 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:37 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a 1073741824" returned: 0 in 0.679s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=176,cinder:UPDATE=229,cinder:DELETE=19,cinder:INSERT=55 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=174,cinder:UPDATE=263,cinder:DELETE=23,cinder:INSERT=60 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:37 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a
Apr 09 13:37:37 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:37 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.473s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-86861af4-dfd1-4931-901e-a50c44c7f8b8 tempest-VolumesGetTest-18509421 None] Lock "cinder-2c58b255-7b35-4d89-a7eb-a9d3628cbeb9-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:37 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a" returned: 0 in 0.450s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967451867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb107bd2-da77-422a-82e7-09a1f80de58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275d7c9bf3f04595b87eb8081dd95c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:32Z,use_quota=True,user_id='f484ae7f0fd047a882e6c901135f9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Creating volume fb107bd2-da77-422a-82e7-09a1f80de58e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:37 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e337956-2a96-4678-b25b-1bc489341175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18795888-dfbc-4619-8437-6b9c9486847a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e27aae-ddf3-42cb-96f3-126bd7d60c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:37 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e 1073741824
Apr 09 13:37:37 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:37 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-18795888-dfbc-4619-8437-6b9c9486847a (18795888-dfbc-4619-8437-6b9c9486847a): created successfully
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e27aae-ddf3-42cb-96f3-126bd7d60c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (84a9d563-ac6f-41b0-9aa1-3c7fc0c2425b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0f02613a-7876-40fc-b2f9-0348ad7e174c tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-0727e597-e82d-454b-a613-0a7f1747663f-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "cinder-0727e597-e82d-454b-a613-0a7f1747663f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-0727e597-e82d-454b-a613-0a7f1747663f" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-0727e597-e82d-454b-a613-0a7f1747663f" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3878e0-3987-483e-a370-332fbf461994]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:38 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:38 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:38 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e 1073741824" returned: 0 in 0.591s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:38 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e
Apr 09 13:37:38 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:38 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:38 devstack sudo[88579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f
Apr 09 13:37:38 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:38 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.505s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Creating offline snapshot bb8223ba-038a-49c0-b0e3-ca89c58269ba of volume 2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf0010-2018-4dd8-b182-78e38047bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb107bd2-da77-422a-82e7-09a1f80de58e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e5f807-30ca-47cd-b015-9eb654f7a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfd4ff-5011-42d7-8c99-98f3dae3bcf0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:39 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Volume volume-fb107bd2-da77-422a-82e7-09a1f80de58e (fb107bd2-da77-422a-82e7-09a1f80de58e): created successfully
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e5f807-30ca-47cd-b015-9eb654f7a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Flow 'volume_create_manager' (ddd2a274-024d-4ec1-a272-c259e698a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6a8f8133-71a6-4592-aab1-1f9a4c46a4d0 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created volume successfully.
Apr 09 13:37:39 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7
Apr 09 13:37:39 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:39 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-0727e597-e82d-454b-a613-0a7f1747663f" returned: 0 in 0.422s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-0727e597-e82d-454b-a613-0a7f1747663f" released by "delete_volume" :: held 1.018s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Created reservations ['287f4562-ac5c-471c-b3dc-71ef9fc89e1c', 'b49124be-9696-4ae3-97c7-3ab728df21d7', '57d3ccf6-a598-4fff-b950-07a7d3e4471a', '2ed3865b-1439-42c8-a8c3-a34deef0df2c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:39 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:39 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:39 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" returned: 0 in 0.534s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:39 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba 1G
Apr 09 13:37:39 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:39 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.425s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f780d4a-edf6-43f0-aeee-02bc1aa88d6a tempest-VolumesGetTest-18509421 None] Lock "cinder-0727e597-e82d-454b-a613-0a7f1747663f-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-fb107bd2-da77-422a-82e7-09a1f80de58e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-fb107bd2-da77-422a-82e7-09a1f80de58e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-fb107bd2-da77-422a-82e7-09a1f80de58e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-fb107bd2-da77-422a-82e7-09a1f80de58e" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3f74f-27f6-4c8e-bfe4-e4ce60e277eb]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:40 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e
Apr 09 13:37:40 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:40 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba 1G" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:40 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba
Apr 09 13:37:40 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:40 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e" returned: 0 in 0.568s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:40 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e
Apr 09 13:37:40 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:40 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba" returned: 0 in 0.468s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:40 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba is being set with open permissions: ugo+rw
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:40 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba
Apr 09 13:37:40 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (764a7727-643d-4c77-b018-482542a920b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaca428-d9d8-4ac0-b4da-0e79aebde398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaca428-d9d8-4ac0-b4da-0e79aebde398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1961405453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba055e5-37d1-4e9f-9ea9-ad2e484736e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:41Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad09d5-8688-4c3f-86e9-53f46b6fe636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad09d5-8688-4c3f-86e9-53f46b6fe636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72701056-138d-4781-98cd-9b4638fb725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:40 devstack cinder-volume[82360]: DEBUG cinder.image.glance [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Creating Keystone auth plugin from conf {{(pid=82360) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72701056-138d-4781-98cd-9b4638fb725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dba055e5-37d1-4e9f-9ea9-ad2e484736e9', 'volume_name': 'volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3d7bb20>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16115eda-65ac-423f-ae19-e017ee4ae0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16115eda-65ac-423f-ae19-e017ee4ae0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95212e8a-c759-497e-aa72-b082fce34805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:41 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:41 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3d7bb20>}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Trying to clone dba055e5-37d1-4e9f-9ea9-ad2e484736e9 from image eee3377f-d552-4152-8887-ebf4bcaa9490 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]). {{(pid=82360) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:41 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-fb107bd2-da77-422a-82e7-09a1f80de58e" returned: 0 in 0.550s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:41 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info
Apr 09 13:37:41 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-fb107bd2-da77-422a-82e7-09a1f80de58e" released by "delete_volume" :: held 1.144s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['7fdd0e8b-e940-41b9-8ebd-443c0cecbbd9', '338c0054-37b8-4b02-aaa4-d2ded8eeab57', '48bd33b9-f7f0-4fa2-bb5b-99612842639d', '313ecd0c-36e9-4b66-a026-ff98525c1928'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:41 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:41 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 13:37:41 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b5e0f5-7145-43ed-96d1-849ec2adfc06]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:41 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD
Apr 09 13:37:41 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:41 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info" returned: 0 in 0.477s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:41 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info is being set with open permissions: ugo+rw
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:41 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info
Apr 09 13:37:41 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:41 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.477s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d3b89dc-0918-4f92-9b32-9186996e5467 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-fb107bd2-da77-422a-82e7-09a1f80de58e-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:41 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 is fetched for user ab31f762890b497f9ba64dcd36d91579. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9515b4-c72d-49cc-8322-a2bd25c7c664]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:41 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD
Apr 09 13:37:41 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:42 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.info" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0b584b50-1874-4252-a667-26cb3bce7b82 tempest-SnapshotMetadataTestJSON-2098162765 None] Create snapshot completed successfully
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-18795888-dfbc-4619-8437-6b9c9486847a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-18795888-dfbc-4619-8437-6b9c9486847a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-18795888-dfbc-4619-8437-6b9c9486847a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-18795888-dfbc-4619-8437-6b9c9486847a" acquired by "delete_volume" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6982456-ec92-4a10-a809-a9fbb19e08c1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:42 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a
Apr 09 13:37:42 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:42 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1961405453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba055e5-37d1-4e9f-9ea9-ad2e484736e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:41Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Creating volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:42 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:42 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1073741824
Apr 09 13:37:42 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:42 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a" returned: 0 in 0.533s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:42 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a
Apr 09 13:37:42 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:43 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1073741824" returned: 0 in 0.561s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:43 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:43 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:43 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18795888-dfbc-4619-8437-6b9c9486847a" returned: 0 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-18795888-dfbc-4619-8437-6b9c9486847a" released by "delete_volume" :: held 1.125s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['48ac2653-97fd-4597-8a37-177f3ccdb001', '99d2b5af-b589-46e0-ae07-2893285a7988', 'c4adb679-cd72-4b59-aaf7-18e848f9503f', 'ff0d0351-10c3-45ba-ac5b-fdb3492ff6e6'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "cinder-bb8223ba-038a-49c0-b0e3-ca89c58269ba-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:43 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:43 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-bb8223ba-038a-49c0-b0e3-ca89c58269ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "cinder-quobyte-bb8223ba-038a-49c0-b0e3-ca89c58269ba" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-bb8223ba-038a-49c0-b0e3-ca89c58269ba" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Deleting offline snapshot bb8223ba-038a-49c0-b0e3-ca89c58269ba of volume 2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] snapshot_file for this snap is: volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b5a6c-1b9e-4543-b18f-15751c80177b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:43 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba
Apr 09 13:37:43 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:43 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Attempting download of eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982b9a1-7a21-490f-b25d-681442915688]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:43 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh
Apr 09 13:37:43 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:43 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:43 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.596s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:37:44 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c0b89-2db2-44dc-8c04-d84281612226]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-9d3a8a6a-1548-47ae-88c3-be0b23007b39 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-18795888-dfbc-4619-8437-6b9c9486847a-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:44 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7
Apr 09 13:37:44 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:44 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh" returned: 0 in 0.540s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-bb5aaa9a-c944-4017-99d0-8e1270568bba-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-bb5aaa9a-c944-4017-99d0-8e1270568bba-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:44 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-bb5aaa9a-c944-4017-99d0-8e1270568bba" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:44 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-bb5aaa9a-c944-4017-99d0-8e1270568bba" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c80cc21-9496-4dd3-b464-ef7be366dea3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba
Apr 09 13:37:44 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:44 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba
Apr 09 13:37:44 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:44 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh" returned: 1 in 0.571s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eee3377f-d552-4152-8887-ebf4bcaa9490_pcq5ecsh' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa521e-f963-45ac-9474-83b845740d77]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD
Apr 09 13:37:44 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:44 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba" returned: 0 in 0.562s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:44 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba
Apr 09 13:37:44 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:45 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:45 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba
Apr 09 13:37:45 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:45 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] eee3377f-d552-4152-8887-ebf4bcaa9490 was qcow2, converting to raw {{(pid=82360) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:45 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:45 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:45 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bb5aaa9a-c944-4017-99d0-8e1270568bba" returned: 0 in 0.576s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-bb5aaa9a-c944-4017-99d0-8e1270568bba" released by "delete_volume" :: held 1.176s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['3ab06a11-a39d-4277-a459-406f59bc546b', 'b06e27f3-bd99-44a8-9f0f-7bc0e584e294', 'c1b89be4-cd09-4b3d-8376-dfff55d9024d', '35e45ad7-5afe-4fbe-85e4-b85754f6423c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:45 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7.bb8223ba-038a-49c0-b0e3-ca89c58269ba" returned: 0 in 0.548s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-bb8223ba-038a-49c0-b0e3-ca89c58269ba" released by "_delete_snapshot" :: held 2.150s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" released by "delete_snapshot" :: held 2.170s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:45 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:45 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Created reservations ['2b40f303-da2c-4327-819b-0a59bda99594', '7ede9fa8-968d-45c9-873e-11edd27a05d2', 'bda8768e-2e0d-4d9a-ad6e-59305291354c', 'b83d7833-a871-49b4-b86e-bd35b4e9969f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Delete snapshot completed successfully.
Apr 09 13:37:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-38fe59bb-81ee-480f-addb-3a35f8b14d63 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-bb8223ba-038a-49c0-b0e3-ca89c58269ba-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:46 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.598s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Acquiring lock "cinder-6cbdcc8e-2119-4d77-9dc4-25e3402158ef-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-115836a5-1049-48be-b006-85a7e46684d8 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-bb5aaa9a-c944-4017-99d0-8e1270568bba-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "cinder-6cbdcc8e-2119-4d77-9dc4-25e3402158ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Acquiring lock "cinder-quobyte-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "cinder-quobyte-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0748b859-577e-4deb-8fe5-29668820e93c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:46 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef
Apr 09 13:37:46 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:46 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 0 in 1.174s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eee3377f-d552-4152-8887-ebf4bcaa9490_0bfih8bfdevstack@QuobyteHD, size 112.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:37:46 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Converted 112.00 MB image at 95.30 MB/s
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:46 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1G
Apr 09 13:37:46 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-832ec2a0-6472-427f-a7e6-1264b851fd96-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-832ec2a0-6472-427f-a7e6-1264b851fd96-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-832ec2a0-6472-427f-a7e6-1264b851fd96" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-832ec2a0-6472-427f-a7e6-1264b851fd96" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6e462-ccb1-49f4-a00c-f17c83dace0b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:46 devstack sudo[88751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96
Apr 09 13:37:46 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "cinder-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34f80a-252e-430e-b967-61ca1e64795a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:46 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7
Apr 09 13:37:46 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:46 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" returned: 0 in 0.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:46 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef
Apr 09 13:37:46 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:46 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 1G" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[861b710f-5309-4ae8-bf2c-8f282ed88643]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:47 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96" returned: 0 in 0.537s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96
Apr 09 13:37:47 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" returned: 0 in 0.544s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7
Apr 09 13:37:47 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "cinder-quobyte-6cbdcc8e-2119-4d77-9dc4-25e3402158ef" released by "delete_volume" :: held 1.102s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Created reservations ['9f957a0d-5aad-41bc-85ce-7e9003b2fb5b', '60ad8cef-33e3-4b42-9449-22f0032a3637', '22609584-6f9e-4264-9e00-ecc56f73b2b9', 'f0b821fe-64e2-4344-bc2c-9414db040f12'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:47 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 0 in 0.564s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:47 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-832ec2a0-6472-427f-a7e6-1264b851fd96" returned: 0 in 0.551s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-832ec2a0-6472-427f-a7e6-1264b851fd96" released by "delete_volume" :: held 1.112s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['1d0cde14-a91c-425a-8293-ec92d9b0ce56', 'f0ae8c2a-9a16-4a78-b2c9-8233426da581', '5b060453-5298-4962-8bb8-d1105a1c2479', 'e7f0ab9e-49dc-4e7a-b026-9db8b3b558cf'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:47 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-quobyte-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7" released by "delete_volume" :: held 1.059s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Created reservations ['bb92748f-a9bc-4ca3-9ee8-af891d646035', 'd69760d6-13f1-4ec2-aed9-e21d365df63f', '6ec9b445-b7cf-46f2-ae8e-6bd81eeeb513', '32a1ccd9-dedf-48e5-bc5b-c84467963e52'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:47 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:47 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:47 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Deleted volume successfully.
Apr 09 13:37:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1bd76f4b-b902-4211-8e0a-6e5ecb2f99a5 tempest-VolumesNegativeTest-410114958 None] Lock "cinder-6cbdcc8e-2119-4d77-9dc4-25e3402158ef-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:48 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 1 in 0.552s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Downloaded image eee3377f-d552-4152-8887-ebf4bcaa9490 ((None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}])) to volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9 successfully. {{(pid=82360) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Temporary image eee3377f-d552-4152-8887-ebf4bcaa9490 for user ab31f762890b497f9ba64dcd36d91579 is deleted. {{(pid=82360) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.volume_utils [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Marking volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9 as bootable. {{(pid=82360) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Copying metadata from image eee3377f-d552-4152-8887-ebf4bcaa9490 to dba055e5-37d1-4e9f-9ea9-ad2e484736e9. {{(pid=82360) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Creating volume glance metadata for volume dba055e5-37d1-4e9f-9ea9-ad2e484736e9 backed by image eee3377f-d552-4152-8887-ebf4bcaa9490 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82360) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95212e8a-c759-497e-aa72-b082fce34805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9', 'volume_size': 1, 'image_id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eee3377f-d552-4152-8887-ebf4bcaa9490', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ede4d29844ce43c7940135a918319fd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eee3377f-d552-4152-8887-ebf4bcaa9490', 'created_at': datetime.datetime(2026, 4, 9, 11, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eee3377f-d552-4152-8887-ebf4bcaa9490/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f31b3d7bb20>}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e369e578-e0b3-4b7f-80bd-416ca5001ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:48 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Volume volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 (dba055e5-37d1-4e9f-9ea9-ad2e484736e9): created successfully
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e369e578-e0b3-4b7f-80bd-416ca5001ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (764a7727-643d-4c77-b018-482542a920b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ce196f24-88ff-47ad-bd3a-7e53d06970c1 tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-dccf98e4-5816-4d1d-89f3-148f441d886f tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-832ec2a0-6472-427f-a7e6-1264b851fd96-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:48 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Deleted volume successfully.
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f39421fd-26a8-4e4d-9988-fb4b1484c663 tempest-SnapshotMetadataTestJSON-2098162765 None] Lock "cinder-2581dcfc-aeda-4d6c-b15c-b288ae7f52a7-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-58e90174-97eb-417d-9e9a-5eac6642caaa-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-58e90174-97eb-417d-9e9a-5eac6642caaa-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-58e90174-97eb-417d-9e9a-5eac6642caaa" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-58e90174-97eb-417d-9e9a-5eac6642caaa" acquired by "delete_volume" :: waited 0.017s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab52f13c-ea6a-41d1-b6b2-d377dd071e2d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:48 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa
Apr 09 13:37:48 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:49 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa" returned: 0 in 0.651s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:49 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa
Apr 09 13:37:49 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (1f63ceb3-0ce8-4ea9-86ee-2dc401d5fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b69dea-b2eb-401c-ab63-d39f964fd724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b69dea-b2eb-401c-ab63-d39f964fd724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435391585',display_name='tempest-VolumesGetTest-Volume-1520469891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bb7485-67a0-4f01-9eeb-c6fd07515790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:50Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ade7ce8-789b-4ec7-a768-27b00aff0bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ade7ce8-789b-4ec7-a768-27b00aff0bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f4cdf0-f559-43b7-80e9-9697aa19f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f4cdf0-f559-43b7-80e9-9697aa19f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bb7485-67a0-4f01-9eeb-c6fd07515790', 'volume_name': 'volume-78bb7485-67a0-4f01-9eeb-c6fd07515790', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c75ffb-8077-4902-8ff8-8aa9c996510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c75ffb-8077-4902-8ff8-8aa9c996510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84c1946-e713-4a7e-92af-801289bb8187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:49 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Volume 78bb7485-67a0-4f01-9eeb-c6fd07515790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bb7485-67a0-4f01-9eeb-c6fd07515790', 'volume_size': 1}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435391585',display_name='tempest-VolumesGetTest-Volume-1520469891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bb7485-67a0-4f01-9eeb-c6fd07515790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8525b1730e4d85a3e01f11f468218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:50Z,use_quota=True,user_id='ab31f762890b497f9ba64dcd36d91579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Creating volume 78bb7485-67a0-4f01-9eeb-c6fd07515790 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:49 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:49 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 1073741824
Apr 09 13:37:49 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:49 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58e90174-97eb-417d-9e9a-5eac6642caaa" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-58e90174-97eb-417d-9e9a-5eac6642caaa" released by "delete_volume" :: held 1.252s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['d22dfd6b-9190-408a-b837-61fdb7cf818e', '892dc0df-2ef1-467c-a8c9-f36ffe59e9f9', 'f79e7517-e1ca-4896-a5d1-42e53cbbd6fc', 'ad0ad83a-8f8a-422e-8dc0-1a7149511703'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:50 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:50 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Flow 'volume_create_manager' (244b41ee-83dd-48b8-938d-7076d5830472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbb583b-e1cb-4e6e-a6fc-da0877fc8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbb583b-e1cb-4e6e-a6fc-da0877fc8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1787515410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd668f64-84c4-440f-8b48-562b85070049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6f732d0d564acfbe69721477e4700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:50Z,use_quota=True,user_id='49631b3a2bf048bb919287c189d3793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d6ad48-ed1f-4736-88be-e0d0dd435e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d6ad48-ed1f-4736-88be-e0d0dd435e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68a5a6-4fcc-4615-9b1e-5d1689660cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68a5a6-4fcc-4615-9b1e-5d1689660cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd668f64-84c4-440f-8b48-562b85070049', 'volume_name': 'volume-bd668f64-84c4-440f-8b48-562b85070049', 'volume_size': 2}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c66472e-9f10-4bcf-99a5-d3724b305056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c66472e-9f10-4bcf-99a5-d3724b305056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491ff55b-72d3-4ba6-9225-f312530a215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Volume bd668f64-84c4-440f-8b48-562b85070049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd668f64-84c4-440f-8b48-562b85070049', 'volume_size': 2}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:50 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 1073741824" returned: 0 in 0.599s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:50 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790
Apr 09 13:37:50 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:50 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-53203a15-c083-4588-9d7b-f1e21448b479 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-58e90174-97eb-417d-9e9a-5eac6642caaa-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:37:50 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Flow 'volume_create_manager' (8610a098-8511-4b17-92cb-76f73c0ea524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06fe58-fcfb-47d1-8592-f51b407cf285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-1c5db290-6a31-4a92-b52a-94f30d04e744-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790" returned: 0 in 0.489s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1787515410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd668f64-84c4-440f-8b48-562b85070049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6f732d0d564acfbe69721477e4700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:50Z,use_quota=True,user_id='49631b3a2bf048bb919287c189d3793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Creating volume bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:50 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 2147483648 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:51 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 2147483648
Apr 09 13:37:51 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06fe58-fcfb-47d1-8592-f51b407cf285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-677138334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba045103-0d5d-4842-82ac-a6d9862adad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e39b369fb84bb1a6cbb2d85959f36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:51Z,use_quota=True,user_id='c89ef5f192a443fe8741b29e6e7e69b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f11329a-7320-48bd-934e-a6eb4756aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f11329a-7320-48bd-934e-a6eb4756aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2448b072-cf10-42e1-940b-4fff0117ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2448b072-cf10-42e1-940b-4fff0117ef69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba045103-0d5d-4842-82ac-a6d9862adad2', 'volume_name': 'volume-ba045103-0d5d-4842-82ac-a6d9862adad2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619abe7c-9dae-416e-8355-aa763f649d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619abe7c-9dae-416e-8355-aa763f649d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa665bd-bac6-4b9c-ae52-aa095c0b616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:51 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Volume ba045103-0d5d-4842-82ac-a6d9862adad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba045103-0d5d-4842-82ac-a6d9862adad2', 'volume_size': 1}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-1c5db290-6a31-4a92-b52a-94f30d04e744-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84c1946-e713-4a7e-92af-801289bb8187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bb7485-67a0-4f01-9eeb-c6fd07515790', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df83d1-3fc9-4e26-916d-f8688e1d8410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:51 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Volume volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 (78bb7485-67a0-4f01-9eeb-c6fd07515790): created successfully
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df83d1-3fc9-4e26-916d-f8688e1d8410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Flow 'volume_create_manager' (1f63ceb3-0ce8-4ea9-86ee-2dc401d5fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "cinder-quobyte-1c5db290-6a31-4a92-b52a-94f30d04e744" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:51 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0b0690b2-e96d-483e-9a3d-f3f9527b31e9 tempest-VolumesGetTest-18509421 None] Created volume successfully.
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-1c5db290-6a31-4a92-b52a-94f30d04e744" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e502a-86c0-4a2b-872c-7f84e964a64a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:51 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744
Apr 09 13:37:51 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:51 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 2147483648" returned: 0 in 0.530s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:51 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049
Apr 09 13:37:51 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:51 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744" returned: 0 in 0.545s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:51 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744
Apr 09 13:37:51 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:52 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049" returned: 0 in 0.476s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-677138334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba045103-0d5d-4842-82ac-a6d9862adad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e39b369fb84bb1a6cbb2d85959f36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:51Z,use_quota=True,user_id='c89ef5f192a443fe8741b29e6e7e69b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Creating volume ba045103-0d5d-4842-82ac-a6d9862adad2 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:37:52 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491ff55b-72d3-4ba6-9225-f312530a215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd668f64-84c4-440f-8b48-562b85070049', 'volume_size': 2}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c830749f-80d1-48de-bf10-6334835c47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:52 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 1073741824
Apr 09 13:37:52 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-78bb7485-67a0-4f01-9eeb-c6fd07515790-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:52 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Volume volume-bd668f64-84c4-440f-8b48-562b85070049 (bd668f64-84c4-440f-8b48-562b85070049): created successfully
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c830749f-80d1-48de-bf10-6334835c47e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Flow 'volume_create_manager' (244b41ee-83dd-48b8-938d-7076d5830472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4430ceb6-150d-40cc-999b-708ac4942c7f tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Created volume successfully.
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "cinder-78bb7485-67a0-4f01-9eeb-c6fd07515790-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:52 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c5db290-6a31-4a92-b52a-94f30d04e744" returned: 0 in 0.444s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-78bb7485-67a0-4f01-9eeb-c6fd07515790" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-quobyte-1c5db290-6a31-4a92-b52a-94f30d04e744" released by "delete_volume" :: held 1.026s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-78bb7485-67a0-4f01-9eeb-c6fd07515790" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[36048d61-d7b4-4081-9931-7f60862afe15]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Created reservations ['993c9c1a-c654-4eac-967a-0eed904e8e26', '9380b655-44c7-49d6-a016-b9ee7fada6d9', '9e04809f-b296-4021-b141-56d9bac882ce', '2dd9ddfd-f13f-43c7-9e88-3d0aee4b437f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:52 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:52 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:52 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:52 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:52 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 1073741824" returned: 0 in 0.585s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:52 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2
Apr 09 13:37:52 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:52 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Deleted volume successfully.
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-470e2063-3554-4620-944f-bb4fc265cbe5 tempest-CreateVolumesFromSourceVolumeTest-279877346 None] Lock "cinder-1c5db290-6a31-4a92-b52a-94f30d04e744-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:52 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790" returned: 0 in 0.609s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:52 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790
Apr 09 13:37:52 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:53 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa665bd-bac6-4b9c-ae52-aa095c0b616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba045103-0d5d-4842-82ac-a6d9862adad2', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb36a10-da07-4010-a3a5-d7bdbf6e71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Creating offline snapshot 94744fce-47dd-4691-9f74-5f6cf08413f1 of volume bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b8562-750b-48d0-a677-1d44192299c9]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Volume volume-ba045103-0d5d-4842-82ac-a6d9862adad2 (ba045103-0d5d-4842-82ac-a6d9862adad2): created successfully
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb36a10-da07-4010-a3a5-d7bdbf6e71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Flow 'volume_create_manager' (8610a098-8511-4b17-92cb-76f73c0ea524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:37:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4395e230-9902-40e4-bf62-d9ccd77d7ffd tempest-VolumesMetadataTest-1553258031 None] Created volume successfully.
Apr 09 13:37:53 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-78bb7485-67a0-4f01-9eeb-c6fd07515790" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-78bb7485-67a0-4f01-9eeb-c6fd07515790" released by "delete_volume" :: held 1.073s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:53 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049
Apr 09 13:37:53 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Created reservations ['1320f0f6-ec76-4a2f-9f67-d0554d6c37e5', '65edc783-8258-4380-ad20-5724451cb2fc', '290ef6da-5fb7-4919-a56c-b76efd18c48e', '9504a906-8081-452e-af10-b70ca3999a83'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:53 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:53 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:53 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.453s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:53 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049" returned: 0 in 0.610s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 2G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3013a34c-0c4f-4fe3-b44e-9f9b9d0ec6a7 tempest-VolumesGetTest-18509421 None] Lock "cinder-78bb7485-67a0-4f01-9eeb-c6fd07515790-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:53 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 2G
Apr 09 13:37:53 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-dba055e5-37d1-4e9f-9ea9-ad2e484736e9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "cinder-dba055e5-37d1-4e9f-9ea9-ad2e484736e9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Acquiring lock "cinder-quobyte-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:54 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 2G" returned: 0 in 0.635s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd668f64-84c4-440f-8b48-562b85070049 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:54 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd668f64-84c4-440f-8b48-562b85070049 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1
Apr 09 13:37:54 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb83e4-269a-4695-bc44-596bdaf03905]: (4, 'raw') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:54 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:54 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Acquiring lock "cinder-ba045103-0d5d-4842-82ac-a6d9862adad2-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "cinder-ba045103-0d5d-4842-82ac-a6d9862adad2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Acquiring lock "cinder-quobyte-ba045103-0d5d-4842-82ac-a6d9862adad2" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "cinder-quobyte-ba045103-0d5d-4842-82ac-a6d9862adad2" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b28eb8-e33b-4d6f-97a0-10e3f34a1acc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:54 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2
Apr 09 13:37:54 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd668f64-84c4-440f-8b48-562b85070049 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1" returned: 0 in 0.608s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 is being set with open permissions: ugo+rw
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:55 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 0 in 0.606s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:55 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1
Apr 09 13:37:55 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:55 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:55 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2" returned: 0 in 0.646s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:55 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info
Apr 09 13:37:55 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2
Apr 09 13:37:55 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 1 in 0.632s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9' failed. Not Retrying. {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:55 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9
Apr 09 13:37:55 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:55 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info" returned: 0 in 0.472s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:55 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info is being set with open permissions: ugo+rw
Apr 09 13:37:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:56 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info
Apr 09 13:37:56 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:56 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ba045103-0d5d-4842-82ac-a6d9862adad2" returned: 0 in 0.506s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "cinder-quobyte-ba045103-0d5d-4842-82ac-a6d9862adad2" released by "delete_volume" :: held 1.186s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Created reservations ['54479790-1288-40f8-9980-31065a064276', 'da29ff49-5871-4a2c-b374-a715dffb3599', '8f1e0aab-d312-44e7-9034-459d1c840b9b', '4486bd95-11ea-4c78-bce0-bda24360ed26'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:56 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" returned: 0 in 0.459s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "cinder-quobyte-dba055e5-37d1-4e9f-9ea9-ad2e484736e9" released by "delete_volume" :: held 1.758s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:56 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:56 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Created reservations ['f781fe8c-c70a-48b2-ac3e-e11df1c6574f', '6a95f003-ed7f-4112-a3db-e4d199ab4164', '8e430cd5-1621-422d-921e-10117c45135b', '290d2f42-da56-4dbb-b8bd-c384d77dfe86'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:56 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:37:56 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:56 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.info" returned: 0 in 0.467s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.332s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:37:56 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ad417192-872d-4491-bfc2-ebb10ae0f654 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Create snapshot completed successfully
Apr 09 13:37:56 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.563s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:56 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Deleted volume successfully.
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8e844bc-826b-47c9-8762-b14a968ed0be tempest-VolumesMetadataTest-1553258031 None] Lock "cinder-ba045103-0d5d-4842-82ac-a6d9862adad2-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "cinder-94744fce-47dd-4691-9f74-5f6cf08413f1-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-94744fce-47dd-4691-9f74-5f6cf08413f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "cinder-quobyte-94744fce-47dd-4691-9f74-5f6cf08413f1" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-94744fce-47dd-4691-9f74-5f6cf08413f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Deleting offline snapshot 94744fce-47dd-4691-9f74-5f6cf08413f1 of volume bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] snapshot_file for this snap is: volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe5fc3-5e5e-490d-b75f-1fb173cd4d91]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:56 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.610s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:37:56 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Deleted volume successfully.
Apr 09 13:37:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1d71e44f-e9cc-470c-be0b-e384e20087a4 tempest-VolumesGetTest-18509421 None] Lock "cinder-dba055e5-37d1-4e9f-9ea9-ad2e484736e9-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:56 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1
Apr 09 13:37:56 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:57 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1" returned: 0 in 0.617s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:57 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd668f64-84c4-440f-8b48-562b85070049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:37:57 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0153a22-1800-4616-8e86-fc7134f332f0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:37:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:57 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049
Apr 09 13:37:57 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:58 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049" returned: 0 in 0.665s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:58 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1
Apr 09 13:37:58 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:59 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1" returned: 0 in 0.881s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:37:59 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1
Apr 09 13:37:59 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:37:59 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049.94744fce-47dd-4691-9f74-5f6cf08413f1" returned: 0 in 0.669s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-94744fce-47dd-4691-9f74-5f6cf08413f1" released by "_delete_snapshot" :: held 2.916s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" released by "delete_snapshot" :: held 2.939s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Created reservations ['65710b2e-9d78-4426-b5c5-2fedcdf43263', 'feb6b3c2-125d-4500-8d9a-53bf9ecadced', 'dfb794ae-4ba0-45c9-863f-b06d260aa707', 'fb7f31b6-6149-4c67-8b11-370f4603f64c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:37:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Delete snapshot completed successfully.
Apr 09 13:37:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-16329ba6-ebe8-43d4-802c-01080ef12d93 tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-94744fce-47dd-4691-9f74-5f6cf08413f1-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "cinder-bd668f64-84c4-440f-8b48-562b85070049-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-bd668f64-84c4-440f-8b48-562b85070049-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc700f9c-4fab-456f-923a-05aa59d49717]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:00 devstack sudo[88921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049
Apr 09 13:38:00 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:00 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049" returned: 0 in 0.644s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:00 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049
Apr 09 13:38:00 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Flow 'volume_create_manager' (360cdc0e-fa16-4a63-b6bb-5b9fddfe2040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8198d6-c6fd-4a40-9586-a493418f5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8198d6-c6fd-4a40-9586-a493418f5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1587386260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c00bb6918045f1ae1acaf43800614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:01Z,use_quota=True,user_id='58422f002e8d4db6be0fbdf545c146b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d1dea-30f9-46b2-b87e-6f6a7d6ef84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d1dea-30f9-46b2-b87e-6f6a7d6ef84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eea0cf-6cb3-47ac-b31e-e77b2433c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eea0cf-6cb3-47ac-b31e-e77b2433c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d', 'volume_name': 'volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4276c0-18c8-421b-8be3-8e0d9b9a7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4276c0-18c8-421b-8be3-8e0d9b9a7166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f35555-7c6b-4127-b593-ae7069a066bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:01 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Volume ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d', 'volume_size': 1}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1587386260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c00bb6918045f1ae1acaf43800614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:01Z,use_quota=True,user_id='58422f002e8d4db6be0fbdf545c146b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Creating volume ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:01 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:01 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d 1073741824
Apr 09 13:38:01 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:01 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-bd668f64-84c4-440f-8b48-562b85070049" returned: 0 in 0.675s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-quobyte-bd668f64-84c4-440f-8b48-562b85070049" released by "delete_volume" :: held 1.355s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Created reservations ['cb9962f8-3c57-4a9b-83c4-dcc2132c2755', '6fb9fe69-19a3-450b-9f81-425f832877d2', 'e674db74-30aa-4a36-9059-e400137152cd', 'fae617f7-52e2-4b07-8bee-c716cba1bec7'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:01 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:01 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:01 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d 1073741824" returned: 0 in 0.799s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:01 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d
Apr 09 13:38:01 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:02 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.854s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Deleted volume successfully.
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-87421aa9-2557-49b3-a905-e4d386e4c4de tempest-VolumesSnapshotNegativeTestJSON-445247567 None] Lock "cinder-bd668f64-84c4-440f-8b48-562b85070049-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:02 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" returned: 0 in 0.802s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f35555-7c6b-4127-b593-ae7069a066bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96048a71-5813-4a3c-9085-c2d54e0da758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:02 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Volume volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d (ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d): created successfully
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96048a71-5813-4a3c-9085-c2d54e0da758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Flow 'volume_create_manager' (360cdc0e-fa16-4a63-b6bb-5b9fddfe2040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-49c77345-ae55-4fd9-9f71-bb839de5469b tempest-VolumesTransfersV355Test-140195004 None] Created volume successfully.
Apr 09 13:38:03 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-678cba83-3bc8-487f-9bd2-242f4ac8db44 tempest-VolumesTransfersV355Test-690295668 None] Transfer volume completed successfully.
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "cinder-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "cinder-quobyte-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-quobyte-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" acquired by "delete_volume" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[b155352c-b41b-4384-a9b4-91dd09f1207c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:04 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d
Apr 09 13:38:04 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:05 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" returned: 0 in 0.646s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:05 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d
Apr 09 13:38:05 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:05 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:05 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:05 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.644s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:05 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" returned: 0 in 0.671s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-quobyte-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d" released by "delete_volume" :: held 1.341s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Created reservations ['c8bb00bd-3206-46ae-ac9f-3a63373fe053', '1a87b1be-a7f3-4166-a1cc-a6144407002f', '4a7f2972-74a7-433e-8bb6-efcfb876d976', 'b3316cef-5b5e-45ab-aad0-f88691b16a6e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:05 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:05 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (44e8954f-13df-4a22-a57d-f36a08b85df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb37711-07aa-4d88-a673-2e9ed1e66ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb37711-07aa-4d88-a673-2e9ed1e66ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921976603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1104cae8-40d1-41bd-a827-6c4c35b29cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:06Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f16636-03ff-4903-bd19-a67a42a74ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f16636-03ff-4903-bd19-a67a42a74ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483d2278-4c85-415e-ac76-0101b1aa448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483d2278-4c85-415e-ac76-0101b1aa448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1104cae8-40d1-41bd-a827-6c4c35b29cf4', 'volume_name': 'volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f5be3f-6565-499f-9748-aa527085f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f5be3f-6565-499f-9748-aa527085f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be9647-b2b6-4830-a37e-10a8bb695374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Volume 1104cae8-40d1-41bd-a827-6c4c35b29cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4', 'volume_size': 1}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921976603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1104cae8-40d1-41bd-a827-6c4c35b29cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:06Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Creating volume 1104cae8-40d1-41bd-a827-6c4c35b29cf4 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:06 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:06 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 1073741824
Apr 09 13:38:06 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:06 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.563s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Deleted volume successfully.
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4c4edb22-08f0-4a83-97a8-20416ecf0820 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-ec9b3de4-f9e6-493b-8a4b-abf81fde3f7d-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (bcaa4d2e-f5ba-4460-a33e-eaed080df2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3deccd-5ba9-424a-b528-001ded281cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3deccd-5ba9-424a-b528-001ded281cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476287019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c37836b-bd82-4759-9094-a2899cba105c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c66720-1b6f-48c8-84ee-28abf88d320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c66720-1b6f-48c8-84ee-28abf88d320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83de4464-405c-4d08-964d-946b4edac7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83de4464-405c-4d08-964d-946b4edac7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c37836b-bd82-4759-9094-a2899cba105c', 'volume_name': 'volume-1c37836b-bd82-4759-9094-a2899cba105c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e7a50d-84c6-4b7b-8eaf-3727ba5a15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e7a50d-84c6-4b7b-8eaf-3727ba5a15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f588e3-4b1b-476d-acb4-1795dd0df6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:06 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Volume 1c37836b-bd82-4759-9094-a2899cba105c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c37836b-bd82-4759-9094-a2899cba105c', 'volume_size': 1}
Apr 09 13:38:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (715d2b46-d468-48eb-851f-4342962c3c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789238af-c21a-4e26-89e7-1b4b908b879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789238af-c21a-4e26-89e7-1b4b908b879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040851542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cacae2-55f0-412e-b99b-a642c2945ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11411390-a5d4-48be-ae42-753c14aede33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11411390-a5d4-48be-ae42-753c14aede33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b5effa-6c07-4501-88ac-3bdca8ed232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b5effa-6c07-4501-88ac-3bdca8ed232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cacae2-55f0-412e-b99b-a642c2945ba1', 'volume_name': 'volume-b1cacae2-55f0-412e-b99b-a642c2945ba1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7c823e-fca3-4579-9b34-f2784113798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7c823e-fca3-4579-9b34-f2784113798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbff77ef-5273-4da3-b7f2-35da7459910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Volume b1cacae2-55f0-412e-b99b-a642c2945ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cacae2-55f0-412e-b99b-a642c2945ba1', 'volume_size': 1}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Flow 'volume_create_manager' (7629654f-7498-4654-9cbd-36d4dfdd3976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66b7943-a1b8-4b53-804d-f363046e1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66b7943-a1b8-4b53-804d-f363046e1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005428273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c67e41-5581-471b-b9a0-83597ea5c365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c00bb6918045f1ae1acaf43800614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='58422f002e8d4db6be0fbdf545c146b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfaf55c-f5ad-456e-95c2-47ebb72fd56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfaf55c-f5ad-456e-95c2-47ebb72fd56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688d9635-1eba-4d15-b202-d98b0ff4f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688d9635-1eba-4d15-b202-d98b0ff4f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c67e41-5581-471b-b9a0-83597ea5c365', 'volume_name': 'volume-69c67e41-5581-471b-b9a0-83597ea5c365', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050dd88d-ce43-4acd-980a-a810acf105a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050dd88d-ce43-4acd-980a-a810acf105a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8888b0-d55b-4bb5-aa45-6a558c65c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Volume 69c67e41-5581-471b-b9a0-83597ea5c365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c67e41-5581-471b-b9a0-83597ea5c365', 'volume_size': 1}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:07 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 1073741824" returned: 0 in 1.207s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (24a20835-19d6-4da4-bd57-39f075b6e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cd94d8-6325-4fac-8144-ae3d89abd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cd94d8-6325-4fac-8144-ae3d89abd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528957086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cade65-fb58-4080-91dd-77a5baee4428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f25f1e-9165-4865-8f06-712801bad2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f25f1e-9165-4865-8f06-712801bad2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c85dcf5-c63e-40d5-9982-dfeaaeebc70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c85dcf5-c63e-40d5-9982-dfeaaeebc70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cade65-fb58-4080-91dd-77a5baee4428', 'volume_name': 'volume-73cade65-fb58-4080-91dd-77a5baee4428', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49da6dde-c7fe-432c-9c5e-12decd9b368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49da6dde-c7fe-432c-9c5e-12decd9b368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa88a53-1569-46b4-84f5-30247fe2a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Volume 73cade65-fb58-4080-91dd-77a5baee4428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cade65-fb58-4080-91dd-77a5baee4428', 'volume_size': 1}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (d9fe891f-3fb1-4a26-854b-27ab4f4196d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8c1f0b-ac04-4569-a391-c0dc449b25ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4
Apr 09 13:38:07 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8c1f0b-ac04-4569-a391-c0dc449b25ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806254641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339d3f1f-001d-49a1-b61f-7088daa00151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:08Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffa12b5-41e3-4e81-ab58-431724531f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffa12b5-41e3-4e81-ab58-431724531f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9614af-1b4c-46fe-b8e2-25edcdace310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9614af-1b4c-46fe-b8e2-25edcdace310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339d3f1f-001d-49a1-b61f-7088daa00151', 'volume_name': 'volume-339d3f1f-001d-49a1-b61f-7088daa00151', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183f9fe8-38d6-4fc9-9ddb-fb92606d1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183f9fe8-38d6-4fc9-9ddb-fb92606d1751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80f54e8-2b4b-4a16-85c5-3e5c118548b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Volume 339d3f1f-001d-49a1-b61f-7088daa00151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339d3f1f-001d-49a1-b61f-7088daa00151', 'volume_size': 1}
Apr 09 13:38:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:08 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4" returned: 0 in 0.554s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476287019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c37836b-bd82-4759-9094-a2899cba105c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Creating volume 1c37836b-bd82-4759-9094-a2899cba105c {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:08 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be9647-b2b6-4830-a37e-10a8bb695374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4691f071-e94a-4022-ac02-be5f2a243895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c 1073741824
Apr 09 13:38:08 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Volume volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 (1104cae8-40d1-41bd-a827-6c4c35b29cf4): created successfully
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4691f071-e94a-4022-ac02-be5f2a243895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (44e8954f-13df-4a22-a57d-f36a08b85df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:08 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2a42ebae-39d7-41e5-b447-e5a76d33c26d tempest-CreateVolumesFromImageTest-295861061 None] Created volume successfully.
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (f6f4a1d8-3c25-4e16-bbf9-1b01bd8d3755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b6aec3-d245-42b4-ba68-c71da7bc38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b6aec3-d245-42b4-ba68-c71da7bc38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-295341952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdd0c69-cec8-4732-8bba-52a42ac7d172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:09Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da76f3-cd84-4259-a1a8-8431caf8de61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da76f3-cd84-4259-a1a8-8431caf8de61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c4aac6-bdbe-4e3a-9175-fba8ac36c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c4aac6-bdbe-4e3a-9175-fba8ac36c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdd0c69-cec8-4732-8bba-52a42ac7d172', 'volume_name': 'volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b16d0-0898-47fa-b209-e73d706dfabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b16d0-0898-47fa-b209-e73d706dfabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda96b95-2608-4477-be39-ea1a0ff4f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume 8fdd0c69-cec8-4732-8bba-52a42ac7d172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172', 'volume_size': 1}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c 1073741824" returned: 0 in 0.692s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:08 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c
Apr 09 13:38:08 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:09 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c" returned: 0 in 0.488s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040851542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cacae2-55f0-412e-b99b-a642c2945ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Creating volume b1cacae2-55f0-412e-b99b-a642c2945ba1 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:09 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f588e3-4b1b-476d-acb4-1795dd0df6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c37836b-bd82-4759-9094-a2899cba105c', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b2ec1-2f99-492c-b86c-a9808ae72222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:09 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Volume volume-1c37836b-bd82-4759-9094-a2899cba105c (1c37836b-bd82-4759-9094-a2899cba105c): created successfully
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b2ec1-2f99-492c-b86c-a9808ae72222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:09 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 1073741824
Apr 09 13:38:09 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (bcaa4d2e-f5ba-4460-a33e-eaed080df2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-24532ccd-5de6-4fb2-9456-6b548113b9e3 tempest-CreateVolumesFromImageTest-295861061 None] Created volume successfully.
Apr 09 13:38:10 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 1073741824" returned: 0 in 0.635s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:10 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1
Apr 09 13:38:10 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:10 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005428273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c67e41-5581-471b-b9a0-83597ea5c365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c00bb6918045f1ae1acaf43800614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='58422f002e8d4db6be0fbdf545c146b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Creating volume 69c67e41-5581-471b-b9a0-83597ea5c365 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:10 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbff77ef-5273-4da3-b7f2-35da7459910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cacae2-55f0-412e-b99b-a642c2945ba1', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d272e67-256f-4dde-8d36-12ca6bc804a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:10 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Volume volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 (b1cacae2-55f0-412e-b99b-a642c2945ba1): created successfully
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d272e67-256f-4dde-8d36-12ca6bc804a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:10 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (715d2b46-d468-48eb-851f-4342962c3c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:10 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 1073741824
Apr 09 13:38:10 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3fe11faa-bbe4-46c3-9097-45ed830319d2 tempest-CreateVolumesFromImageTest-295861061 None] Created volume successfully.
Apr 09 13:38:10 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:11 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 1073741824" returned: 0 in 0.703s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:11 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365
Apr 09 13:38:11 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:11 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365" returned: 0 in 0.489s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.204s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528957086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cade65-fb58-4080-91dd-77a5baee4428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:07Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Creating volume 73cade65-fb58-4080-91dd-77a5baee4428 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:11 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8888b0-d55b-4bb5-aa45-6a558c65c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c67e41-5581-471b-b9a0-83597ea5c365', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:11 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 1073741824
Apr 09 13:38:11 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b08302-b8b6-47e2-bbc7-dac999dbefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:11 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Volume volume-69c67e41-5581-471b-b9a0-83597ea5c365 (69c67e41-5581-471b-b9a0-83597ea5c365): created successfully
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b08302-b8b6-47e2-bbc7-dac999dbefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:11 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Flow 'volume_create_manager' (7629654f-7498-4654-9cbd-36d4dfdd3976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:11 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-35bdd3d7-2c9f-4706-aa21-ecd00770ecee tempest-VolumesTransfersV355Test-140195004 None] Created volume successfully.
Apr 09 13:38:12 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 1073741824" returned: 0 in 0.507s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:12 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428
Apr 09 13:38:12 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "cinder-69c67e41-5581-471b-b9a0-83597ea5c365-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-69c67e41-5581-471b-b9a0-83597ea5c365-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "cinder-quobyte-69c67e41-5581-471b-b9a0-83597ea5c365" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-quobyte-69c67e41-5581-471b-b9a0-83597ea5c365" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:12 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd486434-713b-472c-997f-09423c9d8cb3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.148s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806254641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339d3f1f-001d-49a1-b61f-7088daa00151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4435bbe4b2594c80b4acb9b04cd8d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:08Z,use_quota=True,user_id='9ce57809f617406daa6cc9f49e7699fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Creating volume 339d3f1f-001d-49a1-b61f-7088daa00151 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:12 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa88a53-1569-46b4-84f5-30247fe2a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cade65-fb58-4080-91dd-77a5baee4428', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e998bd8-3eef-40b4-bb9c-665a795f470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:12 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 1073741824
Apr 09 13:38:12 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:12 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Volume volume-73cade65-fb58-4080-91dd-77a5baee4428 (73cade65-fb58-4080-91dd-77a5baee4428): created successfully
Apr 09 13:38:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e998bd8-3eef-40b4-bb9c-665a795f470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (24a20835-19d6-4da4-bd57-39f075b6e12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:13 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365
Apr 09 13:38:13 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5d1c88d7-e937-42b8-a2f3-4f64df2055a1 tempest-CreateVolumesFromImageTest-295861061 None] Created volume successfully.
Apr 09 13:38:13 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365" returned: 0 in 0.585s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:13 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365
Apr 09 13:38:13 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:13 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 1073741824" returned: 0 in 0.619s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:13 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151
Apr 09 13:38:13 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:14 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.138s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-295341952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdd0c69-cec8-4732-8bba-52a42ac7d172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:09Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating volume 8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:14 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:14 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:14 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 1073741824
Apr 09 13:38:14 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-69c67e41-5581-471b-b9a0-83597ea5c365" returned: 0 in 0.624s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80f54e8-2b4b-4a16-85c5-3e5c118548b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339d3f1f-001d-49a1-b61f-7088daa00151', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31dd894-642f-4596-8c8c-37857ad4f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Flow 'volume_create_manager' (03c82350-da2f-4b21-99a0-e9498df05966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83593ce3-458c-404f-87f6-3605e21fa8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-quobyte-69c67e41-5581-471b-b9a0-83597ea5c365" released by "delete_volume" :: held 1.312s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83593ce3-458c-404f-87f6-3605e21fa8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823339748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd6e596-d717-4c4a-a021-7df28d3dc7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cbb7c020e6480980cb9508e2d05f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:14Z,use_quota=True,user_id='8b1c2afc7b1b4c46af156d109ceafb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88ef984-7f81-4438-8d22-9da063d294a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88ef984-7f81-4438-8d22-9da063d294a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9556638c-ba01-4cf4-a1d1-614fe3eb62ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9556638c-ba01-4cf4-a1d1-614fe3eb62ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd6e596-d717-4c4a-a021-7df28d3dc7b7', 'volume_name': 'volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf2ed7f-2829-4ed1-93e2-54cde58f5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf2ed7f-2829-4ed1-93e2-54cde58f5143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b818dd56-cf49-40b6-844c-368aa0661ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:14 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Volume acd6e596-d717-4c4a-a021-7df28d3dc7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7', 'volume_size': 1}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:14 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Volume volume-339d3f1f-001d-49a1-b61f-7088daa00151 (339d3f1f-001d-49a1-b61f-7088daa00151): created successfully
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31dd894-642f-4596-8c8c-37857ad4f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Flow 'volume_create_manager' (d9fe891f-3fb1-4a26-854b-27ab4f4196d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:14 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-45316c38-bda7-4343-87fe-1e6c45d3776e tempest-CreateVolumesFromImageTest-295861061 None] Created volume successfully.
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Created reservations ['d80b3e1a-4f60-4fde-bc6b-09da070e3c54', '7215554a-c8dd-483f-991d-b93a361d674f', '8611810a-f084-4438-bc23-b7422958295d', 'dc6d03d9-1d52-4512-8f03-8c96c9a72da2'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:14 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:14 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:14 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 1073741824" returned: 0 in 0.523s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:14 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172
Apr 09 13:38:14 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:14 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.424s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:14 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Deleted volume successfully.
Apr 09 13:38:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-243d015d-cbcf-4b24-a07d-baa6cecb23e1 tempest-VolumesTransfersV355Test-1412651369 None] Lock "cinder-69c67e41-5581-471b-b9a0-83597ea5c365-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:15 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823339748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd6e596-d717-4c4a-a021-7df28d3dc7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cbb7c020e6480980cb9508e2d05f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:14Z,use_quota=True,user_id='8b1c2afc7b1b4c46af156d109ceafb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Creating volume acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:15 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda96b95-2608-4477-be39-ea1a0ff4f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166aaa45-45f7-494d-8774-4dd869c2ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:15 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 1073741824
Apr 09 13:38:15 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:15 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 (8fdd0c69-cec8-4732-8bba-52a42ac7d172): created successfully
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166aaa45-45f7-494d-8774-4dd869c2ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (f6f4a1d8-3c25-4e16-bbf9-1b01bd8d3755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:15 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-76a7047b-fa96-43e6-a37d-b61575fb90a5 tempest-VolumesSnapshotTestJSON-1220949166 None] Created volume successfully.
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-339d3f1f-001d-49a1-b61f-7088daa00151-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-339d3f1f-001d-49a1-b61f-7088daa00151-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-quobyte-339d3f1f-001d-49a1-b61f-7088daa00151" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-339d3f1f-001d-49a1-b61f-7088daa00151" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f90ee-d5ec-4d62-8249-f2f5e75777e2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:15 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151
Apr 09 13:38:15 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:15 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 1073741824" returned: 0 in 0.632s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:15 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:15 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:16 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151" returned: 0 in 0.669s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:16 devstack sudo[89037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151
Apr 09 13:38:16 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:16 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.518s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.721s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b818dd56-cf49-40b6-844c-368aa0661ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7556d596-aa32-43f0-a2a7-89b8cae8fc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:16 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Volume volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 (acd6e596-d717-4c4a-a021-7df28d3dc7b7): created successfully
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7556d596-aa32-43f0-a2a7-89b8cae8fc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Flow 'volume_create_manager' (03c82350-da2f-4b21-99a0-e9498df05966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-aebe97f1-7d70-45b0-8ce2-3d96e802a521 tempest-SnapshotDependencyTests-918558731 None] Created volume successfully.
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Creating offline snapshot 02a75b15-91ef-4ec0-af9e-a0521cbd33e7 of volume 8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec2e4c-b739-4387-98d1-f7be1b49ae52]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:16 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172
Apr 09 13:38:16 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:16 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-339d3f1f-001d-49a1-b61f-7088daa00151" returned: 0 in 0.547s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-339d3f1f-001d-49a1-b61f-7088daa00151" released by "delete_volume" :: held 1.239s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Created reservations ['0e82dae0-2add-4a22-9380-43207d46ac08', 'abf77b1c-df8b-4cf0-af82-47df982c72f3', 'cff4d2c4-ba92-44c1-829b-101106a1e5e5', '67d70159-c80b-40b2-918c-e9cd37d0e848'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:16 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:16 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:16 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172" returned: 0 in 0.596s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:16 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 1G
Apr 09 13:38:16 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:17 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:17 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Deleted volume successfully.
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-518de81c-bd75-434f-b52c-c04276fd454f tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-339d3f1f-001d-49a1-b61f-7088daa00151-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-73cade65-fb58-4080-91dd-77a5baee4428-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-73cade65-fb58-4080-91dd-77a5baee4428-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-quobyte-73cade65-fb58-4080-91dd-77a5baee4428" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-73cade65-fb58-4080-91dd-77a5baee4428" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda3bfb6-f510-4191-a317-9a9fb646fa88]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:17 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:17 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428
Apr 09 13:38:17 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 1G" returned: 0 in 0.656s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:17 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7
Apr 09 13:38:17 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:18 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428" returned: 0 in 0.528s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:18 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428
Apr 09 13:38:18 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:18 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7" returned: 0 in 0.511s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:18 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 is being set with open permissions: ugo+rw
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:18 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7
Apr 09 13:38:18 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:18 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-73cade65-fb58-4080-91dd-77a5baee4428" returned: 0 in 0.440s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-73cade65-fb58-4080-91dd-77a5baee4428" released by "delete_volume" :: held 1.000s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Created reservations ['508c52c4-7228-4cfb-8d49-4ccc99acee98', '5122450b-f41f-4b7b-aea1-4a60ffd11d4f', '77e660f4-07df-42e1-bc25-9a4e311594ca', 'a3cfcee7-235b-441b-a6af-bc4b638378e2'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:18 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7" returned: 0 in 0.495s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:18 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:18 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:18 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info
Apr 09 13:38:18 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Flow 'volume_create_manager' (cf15fe1e-407f-4d9a-a966-9b5c6821518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a90cc3-89be-4964-993a-16c82ccb8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a90cc3-89be-4964-993a-16c82ccb8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331cec51-2862-4abe-bf7c-4eff4bb1af83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400816aa3ad540579baefc4e15678f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='bfa0d60d10b0401498a2a70c1e2a77ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d3eb42-95cd-4e6a-9431-6e7cf5b93753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d3eb42-95cd-4e6a-9431-6e7cf5b93753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:19 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1de05-d768-488c-9ac1-3188782422b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1de05-d768-488c-9ac1-3188782422b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331cec51-2862-4abe-bf7c-4eff4bb1af83', 'volume_name': 'volume-331cec51-2862-4abe-bf7c-4eff4bb1af83', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdad8843-f943-4566-9723-b66fe1f88e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdad8843-f943-4566-9723-b66fe1f88e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1595b7d3-4429-4d2d-ac46-c3d8711a9b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:19 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Volume 331cec51-2862-4abe-bf7c-4eff4bb1af83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331cec51-2862-4abe-bf7c-4eff4bb1af83', 'volume_size': 1}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:19 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info is being set with open permissions: ugo+rw
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:19 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Deleted volume successfully.
Apr 09 13:38:19 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info
Apr 09 13:38:19 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-24ca63a9-0c44-46a2-954d-9265d45a8470 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-73cade65-fb58-4080-91dd-77a5baee4428-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:19 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.info" returned: 0 in 0.431s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.281s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.271s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Creating offline snapshot 3b03e344-51af-4712-a47e-4b9fb1e0ad32 of volume acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f58ac-9dbf-4787-b141-42ad6a344e0b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-b1cacae2-55f0-412e-b99b-a642c2945ba1-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-64e4e120-36fe-464e-b271-540ee71d5fdf tempest-VolumesSnapshotTestJSON-1220949166 None] Create snapshot completed successfully
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-b1cacae2-55f0-412e-b99b-a642c2945ba1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:19 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:19 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-quobyte-b1cacae2-55f0-412e-b99b-a642c2945ba1" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-b1cacae2-55f0-412e-b99b-a642c2945ba1" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93051a3-2821-4ed9-a17f-2bbd49386a34]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:19 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1
Apr 09 13:38:19 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-02a75b15-91ef-4ec0-af9e-a0521cbd33e7-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-02a75b15-91ef-4ec0-af9e-a0521cbd33e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-02a75b15-91ef-4ec0-af9e-a0521cbd33e7" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-02a75b15-91ef-4ec0-af9e-a0521cbd33e7" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Deleting offline snapshot 02a75b15-91ef-4ec0-af9e-a0521cbd33e7 of volume 8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] snapshot_file for this snap is: volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c1077-f8e6-41e0-88bd-a8dd80856643]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:19 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7
Apr 09 13:38:19 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.574s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 1G
Apr 09 13:38:20 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1" returned: 0 in 0.511s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1
Apr 09 13:38:20 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa8bad-00fa-4dd8-abe4-2b23a3aac760]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172
Apr 09 13:38:20 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b1cacae2-55f0-412e-b99b-a642c2945ba1" returned: 0 in 0.412s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-b1cacae2-55f0-412e-b99b-a642c2945ba1" released by "delete_volume" :: held 0.955s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:20 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 1G" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Created reservations ['122a9169-3a5e-4ea8-b93b-642c8c6481f1', 'e4c505ca-ae33-4037-b877-6adf14bec58e', '2aea10f1-566f-4a52-bf2b-1b6c466cb6b0', 'e0865163-f6da-4e4a-b790-bde3558f1f08'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:20 devstack sudo[89104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:20 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:20 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:20 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172" returned: 0 in 0.515s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:20 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7
Apr 09 13:38:20 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:21 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:21 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 is being set with open permissions: ugo+rw
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:21 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:21 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:21 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Deleted volume successfully.
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7d37245f-81ff-4f6b-b2de-0ea0d29d9b74 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-b1cacae2-55f0-412e-b99b-a642c2945ba1-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:21 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7" returned: 0 in 0.473s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:21 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7
Apr 09 13:38:21 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:21 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:21 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info
Apr 09 13:38:21 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-1c37836b-bd82-4759-9094-a2899cba105c-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-1c37836b-bd82-4759-9094-a2899cba105c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-quobyte-1c37836b-bd82-4759-9094-a2899cba105c" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-1c37836b-bd82-4759-9094-a2899cba105c" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:21 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172.02a75b15-91ef-4ec0-af9e-a0521cbd33e7" returned: 0 in 0.434s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2114a8ec-825e-4bbd-be4d-faafd7d2967a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-02a75b15-91ef-4ec0-af9e-a0521cbd33e7" released by "_delete_snapshot" :: held 2.003s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" released by "delete_snapshot" :: held 2.021s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['924c8a0e-db5c-4f70-89a8-4461cb7311fe', '0666eaf9-8d11-49ee-9d43-0038401f11b8', 'f257f5a3-8553-4c17-82dd-241d3ce6b2ef', '980d70f9-9915-4bae-9a98-6a1c8e05a074'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:21 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c
Apr 09 13:38:21 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Delete snapshot completed successfully.
Apr 09 13:38:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-40a9116f-1498-44ff-827d-5e9266226373 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-02a75b15-91ef-4ec0-af9e-a0521cbd33e7-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:22 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info" returned: 0 in 0.448s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:22 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info is being set with open permissions: ugo+rw
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:22 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info
Apr 09 13:38:22 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:22 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c" returned: 0 in 0.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:22 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c
Apr 09 13:38:22 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:22 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.info" returned: 0 in 0.417s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.338s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331cec51-2862-4abe-bf7c-4eff4bb1af83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400816aa3ad540579baefc4e15678f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='bfa0d60d10b0401498a2a70c1e2a77ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Creating volume 331cec51-2862-4abe-bf7c-4eff4bb1af83 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:22 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:22 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 1073741824
Apr 09 13:38:22 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-36f41c3c-66af-46c0-8a56-8d76dbc655f3 tempest-SnapshotDependencyTests-918558731 None] Create snapshot completed successfully
Apr 09 13:38:22 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1c37836b-bd82-4759-9094-a2899cba105c" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-1c37836b-bd82-4759-9094-a2899cba105c" released by "delete_volume" :: held 0.954s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Created reservations ['a416987a-ec7a-48e4-bc29-cbecb883f8f6', '5e7e53f1-53f6-438c-925f-95e44159c552', '170002ee-6c25-46a8-84bc-66803dc77320', '8b607f47-2ba5-4df4-b9af-405f41fe9345'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:22 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:22 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-1104cae8-40d1-41bd-a827-6c4c35b29cf4-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-1104cae8-40d1-41bd-a827-6c4c35b29cf4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:22 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 1073741824" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "cinder-quobyte-1104cae8-40d1-41bd-a827-6c4c35b29cf4" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-1104cae8-40d1-41bd-a827-6c4c35b29cf4" acquired by "delete_volume" :: waited 0.026s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:23 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83
Apr 09 13:38:23 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb44fe7-7f67-4261-bcb1-840139949074]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:23 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4
Apr 09 13:38:23 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:23 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.523s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Deleted volume successfully.
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b4bed548-8a70-4f67-8984-ca5c22346e8e tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-1c37836b-bd82-4759-9094-a2899cba105c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (f25a3eee-c1bb-40e4-ab1d-8279aae763d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63636ff8-7f77-4d6c-ae69-de05acf414af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:23 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4" returned: 0 in 0.562s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63636ff8-7f77-4d6c-ae69-de05acf414af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500776776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e93819-9bda-4892-b33e-388f566c46c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:24Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae4ffe2-5c30-466d-8239-3c7c781826f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae4ffe2-5c30-466d-8239-3c7c781826f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452eb507-66ee-446e-b1b9-da7aaf021229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452eb507-66ee-446e-b1b9-da7aaf021229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e93819-9bda-4892-b33e-388f566c46c8', 'volume_name': 'volume-d0e93819-9bda-4892-b33e-388f566c46c8', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b7940-15df-43ff-bf66-9f69f1e6f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b7940-15df-43ff-bf66-9f69f1e6f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad4021-f96b-436e-afe4-707d623a9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume d0e93819-9bda-4892-b33e-388f566c46c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e93819-9bda-4892-b33e-388f566c46c8', 'volume_size': 1}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83" returned: 0 in 0.629s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500776776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e93819-9bda-4892-b33e-388f566c46c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:24Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating volume d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:23 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:23 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1595b7d3-4429-4d2d-ac46-c3d8711a9b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331cec51-2862-4abe-bf7c-4eff4bb1af83', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 1073741824
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c95d8bc-291c-4938-9239-056589e52cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Volume volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 (331cec51-2862-4abe-bf7c-4eff4bb1af83): created successfully
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c95d8bc-291c-4938-9239-056589e52cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Flow 'volume_create_manager' (cf15fe1e-407f-4d9a-a966-9b5c6821518c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d5b1b679-caf1-44ab-813a-40be03f04730 tempest-CinderUnicodeTest-533569284 None] Created volume successfully.
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Flow 'volume_create_manager' (aec2fb79-bfb0-4e5b-9eb9-8381ea3187cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253f90a0-134d-4afe-be50-bd4f8bf74cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253f90a0-134d-4afe-be50-bd4f8bf74cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13a1414-a6da-4ead-91b5-c36d42a41161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cbb7c020e6480980cb9508e2d05f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b03e344-51af-4712-a47e-4b9fb1e0ad32,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:24Z,use_quota=True,user_id='8b1c2afc7b1b4c46af156d109ceafb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377fb75e-b1e3-47a0-a17f-22749f03440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377fb75e-b1e3-47a0-a17f-22749f03440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0a5089-862a-4837-a457-361c8439c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0a5089-862a-4837-a457-361c8439c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a13a1414-a6da-4ead-91b5-c36d42a41161', 'volume_name': 'volume-a13a1414-a6da-4ead-91b5-c36d42a41161', 'volume_size': 1, 'snapshot_id': '3b03e344-51af-4712-a47e-4b9fb1e0ad32'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1ae39d-9df9-4e2d-bed6-e066b3e28649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1ae39d-9df9-4e2d-bed6-e066b3e28649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f78e04-cdfc-4e67-8acb-2cd2dea27ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:23 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Volume a13a1414-a6da-4ead-91b5-c36d42a41161: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a13a1414-a6da-4ead-91b5-c36d42a41161', 'volume_size': 1, 'snapshot_id': '3b03e344-51af-4712-a47e-4b9fb1e0ad32'}
Apr 09 13:38:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:24 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1104cae8-40d1-41bd-a827-6c4c35b29cf4" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-quobyte-1104cae8-40d1-41bd-a827-6c4c35b29cf4" released by "delete_volume" :: held 1.079s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Created reservations ['68d3ffc6-e8e7-45dd-920d-f7e76a64b17f', 'e4c20780-549d-4ff6-932b-f7cbd8290a13', '15acc803-ba33-4939-82c8-17367fdeb5c7', '0245d6b8-3a41-4b7b-a88c-5aeefd0b458f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:24 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:24 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:24 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 1073741824" returned: 0 in 0.586s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:24 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:24 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Flow 'volume_create_manager' (8cb1d1bc-0c78-44a3-bb97-558ccf9f476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62b1e54-fa7d-4f66-9e30-b41102ea52f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62b1e54-fa7d-4f66-9e30-b41102ea52f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1521050562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ed6090-9adf-48a0-80a7-6d32579162d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400816aa3ad540579baefc4e15678f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:25Z,use_quota=True,user_id='bfa0d60d10b0401498a2a70c1e2a77ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54211673-f51d-43ed-971b-743333c9b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54211673-f51d-43ed-971b-743333c9b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f8e00f-6376-4f0e-aaf9-af187316faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f8e00f-6376-4f0e-aaf9-af187316faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ed6090-9adf-48a0-80a7-6d32579162d3', 'volume_name': 'volume-e4ed6090-9adf-48a0-80a7-6d32579162d3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91ea3b7-4c08-4965-b788-c3a1797449a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91ea3b7-4c08-4965-b788-c3a1797449a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53c1b29-4f8d-4410-aca8-16a357dc06d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Volume e4ed6090-9adf-48a0-80a7-6d32579162d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ed6090-9adf-48a0-80a7-6d32579162d3', 'volume_size': 1}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.521s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Deleted volume successfully.
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2a305b1a-1cb7-4908-8e6a-7e87b46a64c6 tempest-CreateVolumesFromImageTest-295861061 None] Lock "cinder-1104cae8-40d1-41bd-a827-6c4c35b29cf4-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:24 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.847s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32-a13a1414-a6da-4ead-91b5-c36d42a41161" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad4021-f96b-436e-afe4-707d623a9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e93819-9bda-4892-b33e-388f566c46c8', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4298a39a-b6b6-4cc8-b71a-f5e55ee8e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:24 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume volume-d0e93819-9bda-4892-b33e-388f566c46c8 (d0e93819-9bda-4892-b33e-388f566c46c8): created successfully
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4298a39a-b6b6-4cc8-b71a-f5e55ee8e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (f25a3eee-c1bb-40e4-ab1d-8279aae763d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32-a13a1414-a6da-4ead-91b5-c36d42a41161" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Creating volume a13a1414-a6da-4ead-91b5-c36d42a41161 from snapshot 3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c4a2c95a-9805-456c-b3a6-f7cd7c69f3a1 tempest-VolumesSnapshotTestJSON-1220949166 None] Created volume successfully.
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] snapshot: 3b03e344-51af-4712-a47e-4b9fb1e0ad32, volume: a13a1414-a6da-4ead-91b5-c36d42a41161,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f982f161-fc70-4657-b76a-449afe830330]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:24 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:24 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:25 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.510s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8fd707-803a-4776-b518-f09d059d18ce]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:25 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:25 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:25 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.618s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:38:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:26 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161
Apr 09 13:38:26 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:27 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161" returned: 0 in 1.954s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13ae95-354e-4267-8836-742e87a2b2f3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:28 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:28 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:28 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.589s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:38:28 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Converted 1024.00 MB image at 523.74 MB/s
Apr 09 13:38:28 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 is being set with open permissions: ugo+rw
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:28 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161
Apr 09 13:38:28 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:28 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161" returned: 0 in 0.430s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" released by "_copy_volume_from_snapshot" :: held 4.163s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32-a13a1414-a6da-4ead-91b5-c36d42a41161" released by "_create_volume_from_snapshot" :: held 4.188s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.225s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.277s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1521050562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ed6090-9adf-48a0-80a7-6d32579162d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400816aa3ad540579baefc4e15678f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:25Z,use_quota=True,user_id='bfa0d60d10b0401498a2a70c1e2a77ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Creating volume e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:28 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:29 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 1073741824
Apr 09 13:38:29 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f78e04-cdfc-4e67-8acb-2cd2dea27ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13a1414-a6da-4ead-91b5-c36d42a41161', 'volume_size': 1, 'snapshot_id': '3b03e344-51af-4712-a47e-4b9fb1e0ad32'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406aa9a9-662f-4bc5-8540-da17a70d6dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:29 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Volume volume-a13a1414-a6da-4ead-91b5-c36d42a41161 (a13a1414-a6da-4ead-91b5-c36d42a41161): created successfully
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406aa9a9-662f-4bc5-8540-da17a70d6dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Flow 'volume_create_manager' (aec2fb79-bfb0-4e5b-9eb9-8381ea3187cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:29 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b24308f9-a085-4049-a3fd-bb00a6a7a12d tempest-SnapshotDependencyTests-918558731 None] Created volume successfully.
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-3b03e344-51af-4712-a47e-4b9fb1e0ad32-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-3b03e344-51af-4712-a47e-4b9fb1e0ad32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Deleting offline snapshot 3b03e344-51af-4712-a47e-4b9fb1e0ad32 of volume acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] snapshot_file for this snap is: volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[96113240-2167-458e-951c-ec954ef4ee73]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:29 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:29 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:29 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 1073741824" returned: 0 in 0.511s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:29 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3
Apr 09 13:38:29 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:29 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cb070-f23a-4ef0-8607-92e91bf04f82]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:29 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:29 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:29 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3" returned: 0 in 0.424s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.108s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53c1b29-4f8d-4410-aca8-16a357dc06d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ed6090-9adf-48a0-80a7-6d32579162d3', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca16ae5c-f2f1-4fa7-aa19-4380049c976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:29 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating offline snapshot 3cb11d45-9217-4ef8-8131-370b02c5da43 of volume d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f482c2-d7d0-4d30-b385-b696cf156e09]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:30 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Volume volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 (e4ed6090-9adf-48a0-80a7-6d32579162d3): created successfully
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca16ae5c-f2f1-4fa7-aa19-4380049c976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Flow 'volume_create_manager' (8cb1d1bc-0c78-44a3-bb97-558ccf9f476e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6369940f-bb0b-4394-93e9-b98f1ffd1b82 tempest-CinderUnicodeTest-533569284 None] Created volume successfully.
Apr 09 13:38:30 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:30 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:30 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.487s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:30 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:30 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:30 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:30 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 1G
Apr 09 13:38:30 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:30 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:30 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32
Apr 09 13:38:30 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:31 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 1G" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e93819-9bda-4892-b33e-388f566c46c8 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:31 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e93819-9bda-4892-b33e-388f566c46c8 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:31 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:31 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7.3b03e344-51af-4712-a47e-4b9fb1e0ad32" returned: 0 in 0.496s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-3b03e344-51af-4712-a47e-4b9fb1e0ad32" released by "_delete_snapshot" :: held 2.013s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" released by "delete_snapshot" :: held 2.026s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Created reservations ['b45795c8-0acb-4486-bf30-62a49b1ffe92', 'b6c1d3f5-a1b5-4a9b-a28d-73358af7532b', '4b20e080-51e6-47af-853e-16ecfb86c9e1', '3ad07568-5eeb-4d37-b7b1-a322b2a1bb74'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Delete snapshot completed successfully.
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6f2f4d64-10da-4d37-bf5c-210969dfab7a tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-3b03e344-51af-4712-a47e-4b9fb1e0ad32-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:31 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e93819-9bda-4892-b33e-388f566c46c8 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.500s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:31 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 is being set with open permissions: ugo+rw
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:31 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:31 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:31 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.394s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:31 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info
Apr 09 13:38:31 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:32 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info" returned: 0 in 0.413s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:32 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info is being set with open permissions: ugo+rw
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:32 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info
Apr 09 13:38:32 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-acd6e596-d717-4c4a-a021-7df28d3dc7b7-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-acd6e596-d717-4c4a-a021-7df28d3dc7b7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84e776-6de3-408a-a3a4-b31548f0a9b2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:32 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:32 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:32 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.info" returned: 0 in 0.432s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.513s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4125efbb-0252-4e6b-a13e-d0e9e2e28ba5 tempest-VolumesSnapshotTestJSON-1220949166 None] Create snapshot completed successfully
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Creating offline snapshot 56486c7f-cbfd-4313-a953-3d3da1b92d51 of volume e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e621e786-03dd-4078-879c-69818712901e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:32 devstack sudo[89261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3
Apr 09 13:38:32 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:32 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.480s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:32 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7
Apr 09 13:38:32 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:33 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3" returned: 0 in 0.543s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:33 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 1G
Apr 09 13:38:33 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:33 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (e6c0e1ce-845f-4135-86e9-59a94415a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa125c89-a075-43c8-8f0e-f5f587c23db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-acd6e596-d717-4c4a-a021-7df28d3dc7b7" returned: 0 in 0.480s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa125c89-a075-43c8-8f0e-f5f587c23db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-721761237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d38e52e-ce10-47f2-8a57-fecd4e4b9f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3cb11d45-9217-4ef8-8131-370b02c5da43,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:33Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb84b0-c978-4ccb-89a4-7089addd4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb84b0-c978-4ccb-89a4-7089addd4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66819eed-3357-41ea-8967-5f07b4ba4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66819eed-3357-41ea-8967-5f07b4ba4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d38e52e-ce10-47f2-8a57-fecd4e4b9f62', 'volume_name': 'volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62', 'volume_size': 2, 'snapshot_id': '3cb11d45-9217-4ef8-8131-370b02c5da43'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ae3058-25bc-4e96-a4d3-c66a798a144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ae3058-25bc-4e96-a4d3-c66a798a144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5729ce3-8fe1-42f7-a153-5ac05d0d6ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Volume 6d38e52e-ce10-47f2-8a57-fecd4e4b9f62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62', 'volume_size': 2, 'snapshot_id': '3cb11d45-9217-4ef8-8131-370b02c5da43'}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-acd6e596-d717-4c4a-a021-7df28d3dc7b7" released by "delete_volume" :: held 1.036s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Created reservations ['d6dd39df-bf7a-4de9-ab4b-cbd2b37f4a65', 'c3b0c7be-e012-4566-bf36-e726182d44ca', '490976b1-3d40-411a-b659-406e15b6c915', 'bd9fd250-8ec2-4518-81d9-d98efacc126c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:33 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:33 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:33 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 1G" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:33 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51
Apr 09 13:38:33 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:33 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Deleted volume successfully.
Apr 09 13:38:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55ba203d-fe8c-4488-9964-ef86284a46c1 tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-acd6e596-d717-4c4a-a021-7df28d3dc7b7-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:34 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:34 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 is being set with open permissions: ugo+rw
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:34 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51
Apr 09 13:38:34 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-a13a1414-a6da-4ead-91b5-c36d42a41161-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-a13a1414-a6da-4ead-91b5-c36d42a41161-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" acquired by "delete_volume" :: waited 0.024s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf999880-9abc-4cf0-b049-52943d8b6242]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:34 devstack sudo[89288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161
Apr 09 13:38:34 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:34 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51" returned: 0 in 0.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:34 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info
Apr 09 13:38:34 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:35 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:35 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161
Apr 09 13:38:35 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:35 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info" returned: 0 in 0.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:35 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info is being set with open permissions: ugo+rw
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:35 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info
Apr 09 13:38:35 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:35 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a13a1414-a6da-4ead-91b5-c36d42a41161" returned: 0 in 0.437s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-quobyte-a13a1414-a6da-4ead-91b5-c36d42a41161" released by "delete_volume" :: held 0.924s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:35 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.info" returned: 0 in 0.417s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.110s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Created reservations ['b95efffb-c329-4536-ab83-0cba09fa21ac', 'e72812dd-a061-4691-b58f-2a1d517dec84', 'c783b3e0-d203-4938-a67e-29b71c31ed36', '28d3f6a3-cfc4-4a52-ad57-47a42c3139ea'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2a1021ea-2b50-4b14-89f1-1c2b3288e9da tempest-CinderUnicodeTest-533569284 None] Create snapshot completed successfully
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Creating volume 6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 from snapshot 3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] snapshot: 3cb11d45-9217-4ef8-8131-370b02c5da43, volume: 6d38e52e-ce10-47f2-8a57-fecd4e4b9f62,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[264afae8-3100-4b44-ad8d-312ee779001e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:35 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:35 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:35 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:35 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:36 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Deleted volume successfully.
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7020241d-4845-43ba-bb1f-d4173aac58bc tempest-SnapshotDependencyTests-918558731 None] Lock "cinder-a13a1414-a6da-4ead-91b5-c36d42a41161-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:36 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.543s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e93819-9bda-4892-b33e-388f566c46c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac977f40-7a47-4531-b5e7-a90d2bc82233]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:36 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:36 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-56486c7f-cbfd-4313-a953-3d3da1b92d51-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-56486c7f-cbfd-4313-a953-3d3da1b92d51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-quobyte-56486c7f-cbfd-4313-a953-3d3da1b92d51" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-56486c7f-cbfd-4313-a953-3d3da1b92d51" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Deleting offline snapshot 56486c7f-cbfd-4313-a953-3d3da1b92d51 of volume e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] snapshot_file for this snap is: volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[033acfc7-b8f9-490c-a925-30e10555d0fe]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:36 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51
Apr 09 13:38:36 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:36 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.590s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:38:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:36 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62
Apr 09 13:38:36 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:37 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ed6090-9adf-48a0-80a7-6d32579162d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:37 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655eb92-24b3-432e-bc27-6ed0694d88e1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:37 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3
Apr 09 13:38:37 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:38 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3" returned: 0 in 1.285s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:38 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51
Apr 09 13:38:38 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:39 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" returned: 0 in 2.273s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bab6d6-995a-422d-86fb-ccc5b3bab9a7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:39 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:39 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:39 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51" returned: 0 in 1.045s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:39 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51
Apr 09 13:38:39 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:39 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.788s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:38:39 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Converted 1024.00 MB image at 450.23 MB/s
Apr 09 13:38:39 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 is being set with open permissions: ugo+rw
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:39 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3.56486c7f-cbfd-4313-a953-3d3da1b92d51" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:39 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62
Apr 09 13:38:39 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:DELETE=26,cinder:UPDATE=279,cinder:SELECT=199,cinder:INSERT=79 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=212,cinder:INSERT=62,cinder:UPDATE=248,cinder:DELETE=22 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-56486c7f-cbfd-4313-a953-3d3da1b92d51" released by "_delete_snapshot" :: held 3.429s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" released by "delete_snapshot" :: held 3.441s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Created reservations ['0f8c365f-a856-4814-9c24-678880775822', '15ff1b14-95c0-45ea-833f-2d6fef42bc5a', '8983fb52-fcfa-44b5-9748-81aab416c5b1', '2c2a6875-29c0-4139-b3e9-50f07c42ef85'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:40 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Delete snapshot completed successfully.
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-fda5c791-8811-43eb-9697-a20345f789e4 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-56486c7f-cbfd-4313-a953-3d3da1b92d51-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:40 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" returned: 0 in 0.488s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" released by "_copy_volume_from_snapshot" :: held 4.748s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" released by "_create_volume_from_snapshot" :: held 4.781s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.810s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5729ce3-8fe1-42f7-a153-5ac05d0d6ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62', 'volume_size': 2, 'snapshot_id': '3cb11d45-9217-4ef8-8131-370b02c5da43'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99461924-e2fa-4fda-a49c-879940b6acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:40 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Volume volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 (6d38e52e-ce10-47f2-8a57-fecd4e4b9f62): created successfully
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99461924-e2fa-4fda-a49c-879940b6acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (e6c0e1ce-845f-4135-86e9-59a94415a982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:40 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f29515b2-8657-4056-9a9d-376c03cb281e tempest-VolumesSnapshotTestJSON-1220949166 None] Created volume successfully.
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-e4ed6090-9adf-48a0-80a7-6d32579162d3-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-e4ed6090-9adf-48a0-80a7-6d32579162d3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e943df4-9dba-4935-b238-38ae50d8a325]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:40 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3
Apr 09 13:38:40 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9141a339-3832-4577-802e-53a2de4e6d4f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:41 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62
Apr 09 13:38:41 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:41 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3" returned: 0 in 0.556s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:41 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3
Apr 09 13:38:41 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:41 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" returned: 0 in 0.572s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:41 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62
Apr 09 13:38:41 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:41 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e4ed6090-9adf-48a0-80a7-6d32579162d3" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-e4ed6090-9adf-48a0-80a7-6d32579162d3" released by "delete_volume" :: held 1.052s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Created reservations ['669fc01a-3843-483a-be03-e087acef70bb', '48fb26c4-b45a-4ff2-bba3-78dd3f87d882', '0ba712d8-eb15-4785-bc8c-293f1645b2e4', 'bbe49ded-1ed0-4513-955a-2f36ea71b86e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:42 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:42 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:42 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62" released by "delete_volume" :: held 1.133s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['31ab9283-4991-4943-b4cc-e3e5e4768c91', '57e89007-ef9c-4ae1-91d4-9c0056e2008e', 'c9b909a0-52bb-425a-9f8c-6a8a851ced17', '7a8f04a6-b987-48ec-99b7-2a26b24b28dd'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:42 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:42 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:42 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Deleted volume successfully.
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5141d1da-152b-41e5-99eb-c756adb6dff9 tempest-CinderUnicodeTest-533569284 None] Lock "cinder-e4ed6090-9adf-48a0-80a7-6d32579162d3-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:42 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Deleted volume successfully.
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c7ec145f-c227-4050-9ef9-0efce2b5d347 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-6d38e52e-ce10-47f2-8a57-fecd4e4b9f62-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-331cec51-2862-4abe-bf7c-4eff4bb1af83-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "cinder-331cec51-2862-4abe-bf7c-4eff4bb1af83-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Acquiring lock "cinder-quobyte-331cec51-2862-4abe-bf7c-4eff4bb1af83" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-331cec51-2862-4abe-bf7c-4eff4bb1af83" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a4a36a-1086-4d95-8618-f4b1557fb826]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:43 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83
Apr 09 13:38:43 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-3cb11d45-9217-4ef8-8131-370b02c5da43-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-3cb11d45-9217-4ef8-8131-370b02c5da43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Deleting offline snapshot 3cb11d45-9217-4ef8-8131-370b02c5da43 of volume d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] snapshot_file for this snap is: volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc3150-d5d3-4500-b995-a810ddf6b5a8]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:43 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:43 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:43 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83" returned: 0 in 0.493s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:43 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83
Apr 09 13:38:43 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:43 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.480s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e93819-9bda-4892-b33e-388f566c46c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db9c15-5292-4d55-bf58-b6270b4469f4]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:43 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-331cec51-2862-4abe-bf7c-4eff4bb1af83" returned: 0 in 0.400s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "cinder-quobyte-331cec51-2862-4abe-bf7c-4eff4bb1af83" released by "delete_volume" :: held 0.923s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:43 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:43 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Created reservations ['90feedc7-a475-46fc-a156-8c4627aeaa4c', '607f24a8-4da3-4a3b-b6e0-f2712767358d', 'd275563b-affa-4b71-ad70-452463fa088f', 'd3e4abfd-92f8-4a33-b31c-0f45eac901e4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:44 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:44 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:44 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:44 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:44 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:44 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:44 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Deleted volume successfully.
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3ec38d80-9d5b-450d-a6a0-6a546232cc4e tempest-CinderUnicodeTest-533569284 None] Lock "cinder-331cec51-2862-4abe-bf7c-4eff4bb1af83-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:44 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:45 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43
Apr 09 13:38:45 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:45 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8.3cb11d45-9217-4ef8-8131-370b02c5da43" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-3cb11d45-9217-4ef8-8131-370b02c5da43" released by "_delete_snapshot" :: held 2.099s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" released by "delete_snapshot" :: held 2.121s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:45 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['2f5e70da-f762-409f-8eff-1a14494f1c50', 'aa2283a6-b654-4ace-bcc2-a997d31e40be', 'b4152a61-5d65-460e-a890-079660a55b60', 'eeb95f2a-de6f-465a-80e8-2b364de1e015'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Delete snapshot completed successfully.
Apr 09 13:38:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-47e743d0-3111-41ec-8126-68c49f97b014 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-3cb11d45-9217-4ef8-8131-370b02c5da43-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-d0e93819-9bda-4892-b33e-388f566c46c8-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-d0e93819-9bda-4892-b33e-388f566c46c8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c099098-8980-482a-82b3-326acca7dc63]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:46 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:46 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:47 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:47 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8
Apr 09 13:38:47 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:47 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-d0e93819-9bda-4892-b33e-388f566c46c8" returned: 0 in 0.409s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-d0e93819-9bda-4892-b33e-388f566c46c8" released by "delete_volume" :: held 0.905s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['1cfda424-64ec-4d39-8832-f5962226bd0c', '8c9d954e-c674-41f2-8ad2-a59b745974eb', 'f0683859-1550-461a-b198-2bd55abfdea6', '962beec5-1082-4da8-82e8-50d39831918e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:47 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:47 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (b84d7580-b57a-488a-a6a5-0e3858bb0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f4685-3f8b-42a0-9fb2-1b66eb1441a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f4685-3f8b-42a0-9fb2-1b66eb1441a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424900629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02a08dd-7689-4135-8a80-f5762330aa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:48Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fea48d-e363-4fe7-aaa8-03ea010d4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fea48d-e363-4fe7-aaa8-03ea010d4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d129cd1-8080-4128-a205-9edb5b590baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d129cd1-8080-4128-a205-9edb5b590baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02a08dd-7689-4135-8a80-f5762330aa91', 'volume_name': 'volume-f02a08dd-7689-4135-8a80-f5762330aa91', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dd2f45-16e9-4ce5-9a6b-71b43089def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dd2f45-16e9-4ce5-9a6b-71b43089def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989989ce-b10c-47d5-8922-3af630c7983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:47 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume f02a08dd-7689-4135-8a80-f5762330aa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02a08dd-7689-4135-8a80-f5762330aa91', 'volume_size': 1}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424900629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02a08dd-7689-4135-8a80-f5762330aa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:48Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating volume f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:47 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:47 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.440s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:47 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Deleted volume successfully.
Apr 09 13:38:47 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 1073741824
Apr 09 13:38:47 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e268201e-d799-49d7-b0fe-b4aba53d380d tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-d0e93819-9bda-4892-b33e-388f566c46c8-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:48 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 1073741824" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:48 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:38:48 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:48 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989989ce-b10c-47d5-8922-3af630c7983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02a08dd-7689-4135-8a80-f5762330aa91', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a3f0c0-eca1-4def-b1fe-7092668e2a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume volume-f02a08dd-7689-4135-8a80-f5762330aa91 (f02a08dd-7689-4135-8a80-f5762330aa91): created successfully
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a3f0c0-eca1-4def-b1fe-7092668e2a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (b84d7580-b57a-488a-a6a5-0e3858bb0390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6586f013-da6b-47d9-a1e0-eb0570813190 tempest-VolumesSnapshotTestJSON-1220949166 None] Created volume successfully.
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating offline snapshot c772b53c-18d8-4806-8f07-209a8ce8aa2f of volume f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a3e83-ddc9-4632-920b-70f608a579dd]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:50 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:38:50 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:50 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:50 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f 1G
Apr 09 13:38:50 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:51 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f 1G" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02a08dd-7689-4135-8a80-f5762330aa91 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:51 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02a08dd-7689-4135-8a80-f5762330aa91 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:38:51 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:51 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02a08dd-7689-4135-8a80-f5762330aa91 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:51 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f is being set with open permissions: ugo+rw
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:51 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:38:51 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:51 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.411s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:52 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info
Apr 09 13:38:52 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:52 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info" returned: 0 in 0.430s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:52 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info is being set with open permissions: ugo+rw
Apr 09 13:38:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:52 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info
Apr 09 13:38:52 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:52 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.info" returned: 0 in 0.418s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f4bdf4fc-02b5-4a2e-b5e7-a7e71866bf82 tempest-VolumesSnapshotTestJSON-1220949166 None] Create snapshot completed successfully
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (9617aad7-9c58-4b43-84bf-b9cf0ef072e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d82425-01d3-412d-94b4-383550861677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d82425-01d3-412d-94b4-383550861677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109213036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41307c51-2aa8-4a07-9816-d6e12b3a05b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b87111e0cd41db80c57e5725cb0b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c772b53c-18d8-4806-8f07-209a8ce8aa2f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:53Z,use_quota=True,user_id='1cc107e12598495faa64e43acbd13105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fcbd84-7c91-494d-b00e-2c30b98b6e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fcbd84-7c91-494d-b00e-2c30b98b6e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c35a2a7-a351-4d61-a08c-6ad99c57f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c35a2a7-a351-4d61-a08c-6ad99c57f768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41307c51-2aa8-4a07-9816-d6e12b3a05b9', 'volume_name': 'volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9', 'volume_size': 1, 'snapshot_id': 'c772b53c-18d8-4806-8f07-209a8ce8aa2f'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfc4676-8d1e-45f6-ba9d-a0420fdd139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfc4676-8d1e-45f6-ba9d-a0420fdd139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf22b36-0d16-42eb-bb62-3eec1a6941a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume 41307c51-2aa8-4a07-9816-d6e12b3a05b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9', 'volume_size': 1, 'snapshot_id': 'c772b53c-18d8-4806-8f07-209a8ce8aa2f'}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f-41307c51-2aa8-4a07-9816-d6e12b3a05b9" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f-41307c51-2aa8-4a07-9816-d6e12b3a05b9" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating volume 41307c51-2aa8-4a07-9816-d6e12b3a05b9 from snapshot c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] snapshot: c772b53c-18d8-4806-8f07-209a8ce8aa2f, volume: 41307c51-2aa8-4a07-9816-d6e12b3a05b9,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5da5f4-aa24-4888-a660-b6e72c18b4fc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:53 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:38:53 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:54 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02a08dd-7689-4135-8a80-f5762330aa91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aeaf5b-6daa-4046-9921-d7a78e6c9b22]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:54 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:38:54 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:54 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:38:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:54 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9
Apr 09 13:38:54 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:56 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9" returned: 0 in 1.962s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a758597d-b032-4de6-9df9-42de329d059f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:56 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:38:56 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:57 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.591s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:38:57 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Converted 1024.00 MB image at 521.52 MB/s
Apr 09 13:38:57 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 is being set with open permissions: ugo+rw
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:57 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9
Apr 09 13:38:57 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:57 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" released by "_copy_volume_from_snapshot" :: held 3.975s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f-41307c51-2aa8-4a07-9816-d6e12b3a05b9" released by "_create_volume_from_snapshot" :: held 3.991s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.999s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf22b36-0d16-42eb-bb62-3eec1a6941a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9', 'volume_size': 1, 'snapshot_id': 'c772b53c-18d8-4806-8f07-209a8ce8aa2f'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b6f03d-72e0-4282-a1f8-5db1aac112ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:38:57 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Volume volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 (41307c51-2aa8-4a07-9816-d6e12b3a05b9): created successfully
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b6f03d-72e0-4282-a1f8-5db1aac112ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Flow 'volume_create_manager' (9617aad7-9c58-4b43-84bf-b9cf0ef072e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:38:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e1a73479-81be-498c-b918-9df7179d73c8 tempest-VolumesSnapshotTestJSON-1220949166 None] Created volume successfully.
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-41307c51-2aa8-4a07-9816-d6e12b3a05b9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-41307c51-2aa8-4a07-9816-d6e12b3a05b9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac744af-6ad2-4da6-861b-ef07cc6cc31d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:57 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9
Apr 09 13:38:57 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:58 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:58 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9
Apr 09 13:38:58 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:58 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-41307c51-2aa8-4a07-9816-d6e12b3a05b9" returned: 0 in 0.405s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-41307c51-2aa8-4a07-9816-d6e12b3a05b9" released by "delete_volume" :: held 0.919s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['15349755-f369-42d9-902b-f3b293e40c52', '5a32d17d-4e6c-4112-a2a1-b52eff6d9db4', '74e17828-742c-4375-bb40-ecf6c934b3b4', 'b1ac0eca-79ed-446a-a2ff-6ffac947f55a'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:58 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:38:58 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-c772b53c-18d8-4806-8f07-209a8ce8aa2f-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-c772b53c-18d8-4806-8f07-209a8ce8aa2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Deleting offline snapshot c772b53c-18d8-4806-8f07-209a8ce8aa2f of volume f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:38:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] snapshot_file for this snap is: volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e332eeb6-6d62-4dc8-8526-4ba852ed1152]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:59 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:38:59 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:38:59 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:38:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Deleted volume successfully.
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-f2df50d1-af6b-45ba-b22f-9179bc714e93 tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-41307c51-2aa8-4a07-9816-d6e12b3a05b9-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:38:59 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.508s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02a08dd-7689-4135-8a80-f5762330aa91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d9ba2-4965-43dd-8aef-0a884faa1fe0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:38:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:38:59 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:38:59 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:00 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:00 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:39:00 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:00 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:00 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f
Apr 09 13:39:00 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:00 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91.c772b53c-18d8-4806-8f07-209a8ce8aa2f" returned: 0 in 0.435s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-c772b53c-18d8-4806-8f07-209a8ce8aa2f" released by "_delete_snapshot" :: held 1.946s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" released by "delete_snapshot" :: held 1.963s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['a071a917-beab-45da-8ab8-15e767772c73', '045c1ba8-496f-441a-a00d-1ae03d0f558c', '1352a61f-a42f-47ba-88ab-38965348f25d', 'bff6a525-eac0-4987-a8aa-9dd75592a29e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Delete snapshot completed successfully.
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-381e495d-07b6-4400-a12c-7fea5ea34cfe tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-c772b53c-18d8-4806-8f07-209a8ce8aa2f-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-f02a08dd-7689-4135-8a80-f5762330aa91-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-f02a08dd-7689-4135-8a80-f5762330aa91-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c458eb-ecf1-4d19-aa59-818b3370c8a2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:01 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:39:01 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:01 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.488s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:01 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91
Apr 09 13:39:01 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:02 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f02a08dd-7689-4135-8a80-f5762330aa91" returned: 0 in 0.407s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-f02a08dd-7689-4135-8a80-f5762330aa91" released by "delete_volume" :: held 0.935s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['cb638819-6b65-43d8-9332-5de849c19fbd', 'ad4d58ae-91fe-418f-a044-8664a1b95513', 'f548ca73-04eb-4bb7-8b8e-1b0ada96b70d', 'ba426eec-090a-4d28-b6f2-8a4cda9b16c0'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:02 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:02 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-8fdd0c69-cec8-4732-8bba-52a42ac7d172-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-8fdd0c69-cec8-4732-8bba-52a42ac7d172-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d315aa-c66b-477c-aabc-6048e8945c52]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:02 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172
Apr 09 13:39:02 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:02 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Deleted volume successfully.
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-09631fd2-7e6c-42fd-82bb-8cc2635ab2cb tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-f02a08dd-7689-4135-8a80-f5762330aa91-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:02 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:02 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172
Apr 09 13:39:02 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:03 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-8fdd0c69-cec8-4732-8bba-52a42ac7d172" returned: 0 in 0.430s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-quobyte-8fdd0c69-cec8-4732-8bba-52a42ac7d172" released by "delete_volume" :: held 0.942s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Created reservations ['fb75db22-f8ef-4e66-b522-3c44babebff1', 'c83daa45-a3ef-4b31-93b9-25becc66d303', '13756d4f-deb9-4e5a-8cda-1549ae991630', 'c1739d1a-91bf-40f5-841e-d2fa928acba1'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:03 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:03 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:03 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.407s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:03 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Deleted volume successfully.
Apr 09 13:39:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-596532f7-f9d3-439b-a983-49491ec1411a tempest-VolumesSnapshotTestJSON-1220949166 None] Lock "cinder-8fdd0c69-cec8-4732-8bba-52a42ac7d172-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:05 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:05 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:05 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Flow 'volume_create_manager' (50507c47-ef21-4688-a238-8516870fe03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4810ea-b3a5-4aee-bde4-79b76b191f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4810ea-b3a5-4aee-bde4-79b76b191f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-238184716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48589869-3486-4da9-aeee-0b349ceb3148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa80d8aff3a44177add99d9059080bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='bda18b4afcd144b78a770ee68f3301fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd1ee3-93b8-41c4-8677-250a8306bdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd1ee3-93b8-41c4-8677-250a8306bdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2017035-86bb-450f-9612-99b2bb1aab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2017035-86bb-450f-9612-99b2bb1aab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48589869-3486-4da9-aeee-0b349ceb3148', 'volume_name': 'volume-48589869-3486-4da9-aeee-0b349ceb3148', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2963fb-740a-4cc6-a205-01845dd0dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2963fb-740a-4cc6-a205-01845dd0dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f1206-a9ae-4082-a180-50cf2f79f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:07 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Volume 48589869-3486-4da9-aeee-0b349ceb3148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48589869-3486-4da9-aeee-0b349ceb3148', 'volume_size': 1}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-238184716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48589869-3486-4da9-aeee-0b349ceb3148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa80d8aff3a44177add99d9059080bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='bda18b4afcd144b78a770ee68f3301fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Creating volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:07 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:07 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 1073741824
Apr 09 13:39:07 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:07 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 1073741824" returned: 0 in 0.475s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:07 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148
Apr 09 13:39:07 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:08 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f1206-a9ae-4082-a180-50cf2f79f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48589869-3486-4da9-aeee-0b349ceb3148', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f21d8c-a1dc-427e-8d19-42cecc22d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:08 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Volume volume-48589869-3486-4da9-aeee-0b349ceb3148 (48589869-3486-4da9-aeee-0b349ceb3148): created successfully
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f21d8c-a1dc-427e-8d19-42cecc22d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:08 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Flow 'volume_create_manager' (50507c47-ef21-4688-a238-8516870fe03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:08 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-772c74dc-473a-4671-a293-808d777d2a13 tempest-VolumesSnapshotListTestJSON-778088156 None] Created volume successfully.
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Creating offline snapshot 26fc8a72-18d6-4170-a217-9083fe6e0a1a of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab8ceb-f477-4008-8f4d-c8df7b1dba54]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:09 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148
Apr 09 13:39:09 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:09 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:09 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a 1G
Apr 09 13:39:09 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:10 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a 1G" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:10 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:10 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:10 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:10 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a is being set with open permissions: ugo+rw
Apr 09 13:39:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:10 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:10 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:11 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:11 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info
Apr 09 13:39:11 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:11 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info" returned: 0 in 0.428s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:11 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info is being set with open permissions: ugo+rw
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:11 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info
Apr 09 13:39:11 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:11 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.info" returned: 0 in 0.399s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b79421e0-7b3a-42b4-a509-1acfa0e663ab tempest-VolumesSnapshotListTestJSON-778088156 None] Create snapshot completed successfully
Apr 09 13:39:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Creating offline snapshot 20daeb47-313d-4333-81b8-701f42ee82b7 of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:39:12 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74958e4-c9c4-4127-aeda-2ffeca8945f1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:12 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:12 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:13 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.466s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:13 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 1G
Apr 09 13:39:13 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:13 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 1G" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:13 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:13 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:13 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.424s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:13 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 is being set with open permissions: ugo+rw
Apr 09 13:39:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:14 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:14 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:14 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.396s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:14 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e7da67fc-8cd6-4794-856e-b719164e2c80 tempest-VolumesSnapshotListTestJSON-778088156 None] Create snapshot completed successfully
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Creating offline snapshot 9a99dd8d-88cb-43de-b322-2384d4768892 of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8a373-a7da-4107-a119-974fc8af8aee]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:14 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:14 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:15 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.461s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:15 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:15 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 1G
Apr 09 13:39:15 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:15 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 1G" returned: 0 in 0.508s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:15 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892
Apr 09 13:39:15 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:16 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892" returned: 0 in 0.415s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:16 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 is being set with open permissions: ugo+rw
Apr 09 13:39:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:16 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892
Apr 09 13:39:16 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:16 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892" returned: 0 in 0.412s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:16 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-679621dd-fec0-4f3b-ad3a-5804c4844917 tempest-VolumesSnapshotListTestJSON-778088156 None] Create snapshot completed successfully
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-9a99dd8d-88cb-43de-b322-2384d4768892-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-9a99dd8d-88cb-43de-b322-2384d4768892-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-9a99dd8d-88cb-43de-b322-2384d4768892" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-9a99dd8d-88cb-43de-b322-2384d4768892" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Deleting offline snapshot 9a99dd8d-88cb-43de-b322-2384d4768892 of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] snapshot_file for this snap is: volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b7527-73ca-48b4-b2b0-9cc92289efd1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:17 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892
Apr 09 13:39:17 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:17 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892" returned: 0 in 0.459s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f475dd-070b-4f2c-b742-3381e70f2fdd]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:18 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:18 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:18 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:18 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892
Apr 09 13:39:18 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:18 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:18 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892
Apr 09 13:39:18 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:19 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.9a99dd8d-88cb-43de-b322-2384d4768892" returned: 0 in 0.397s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-9a99dd8d-88cb-43de-b322-2384d4768892" released by "_delete_snapshot" :: held 1.828s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" released by "delete_snapshot" :: held 1.844s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Created reservations ['e3ce18b5-9bed-40f5-bc11-5ed56be417ce', '2c1d61c7-bb36-405a-8233-4868038c4205', '93c8ed5b-6105-42fc-ba23-76ca2baa54d1', 'df9cc322-16b1-4937-887b-33ae27fcb358'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:19 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Delete snapshot completed successfully.
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-57b0a789-5b20-4260-977a-0d7b3f98c75d tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-9a99dd8d-88cb-43de-b322-2384d4768892-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-20daeb47-313d-4333-81b8-701f42ee82b7-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-20daeb47-313d-4333-81b8-701f42ee82b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-20daeb47-313d-4333-81b8-701f42ee82b7" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-20daeb47-313d-4333-81b8-701f42ee82b7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Deleting offline snapshot 20daeb47-313d-4333-81b8-701f42ee82b7 of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] snapshot_file for this snap is: volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d09cb5-0c5b-4afa-903e-47194036cacd]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:19 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:19 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:20 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.465s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef66fc1-3d68-461d-a8f0-ecf36f6dd12b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:20 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:20 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:20 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:20 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:20 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:21 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:21 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7
Apr 09 13:39:21 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:21 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.20daeb47-313d-4333-81b8-701f42ee82b7" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-20daeb47-313d-4333-81b8-701f42ee82b7" released by "_delete_snapshot" :: held 1.853s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" released by "delete_snapshot" :: held 1.865s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Created reservations ['9c1bf1dc-db1d-41ca-8899-42e52cd6feab', '419f4f45-312d-44a5-9993-362e63ae1db5', '21e60f6d-5172-43c6-bae3-00e4d1639453', '6b9b0161-fba9-4fef-a8f4-091d7b22e48c'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Delete snapshot completed successfully.
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-05b349d5-89b7-4f9f-8cee-0b3dec22c9d8 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-20daeb47-313d-4333-81b8-701f42ee82b7-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-26fc8a72-18d6-4170-a217-9083fe6e0a1a-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-26fc8a72-18d6-4170-a217-9083fe6e0a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-26fc8a72-18d6-4170-a217-9083fe6e0a1a" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-26fc8a72-18d6-4170-a217-9083fe6e0a1a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Deleting offline snapshot 26fc8a72-18d6-4170-a217-9083fe6e0a1a of volume 48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] snapshot_file for this snap is: volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1088d604-7513-4bb3-b0b9-800b47ee9efd]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:21 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:21 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:22 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.459s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48589869-3486-4da9-aeee-0b349ceb3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af42e8-37a2-42a9-a7f2-52bd5db33a9b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:22 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148
Apr 09 13:39:22 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:22 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148" returned: 0 in 0.464s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:22 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:22 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:23 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.434s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:23 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a
Apr 09 13:39:23 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:23 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148.26fc8a72-18d6-4170-a217-9083fe6e0a1a" returned: 0 in 0.398s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-26fc8a72-18d6-4170-a217-9083fe6e0a1a" released by "_delete_snapshot" :: held 1.805s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" released by "delete_snapshot" :: held 1.818s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Created reservations ['9a822f47-34ef-45f3-87c3-2c608ec02fd4', 'f7ae84bd-4129-4bdb-ad7e-5f6b9673a396', 'f49cd4c3-b10b-462b-b977-049b78b4deb8', 'ab5d6a12-8352-4806-957c-6a11fbba7d3e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Delete snapshot completed successfully.
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3f334f4-f542-4f82-8a19-a3ec1afe201f tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-26fc8a72-18d6-4170-a217-9083fe6e0a1a-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-48589869-3486-4da9-aeee-0b349ceb3148-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-48589869-3486-4da9-aeee-0b349ceb3148-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[916bcfb4-f9c2-4413-af3c-197583be9525]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:23 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148
Apr 09 13:39:23 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:24 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:24 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148
Apr 09 13:39:24 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:24 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-48589869-3486-4da9-aeee-0b349ceb3148" returned: 0 in 0.409s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-quobyte-48589869-3486-4da9-aeee-0b349ceb3148" released by "delete_volume" :: held 0.904s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Created reservations ['c0da16ee-502b-497a-86bb-910b0d91e83b', 'c9a2537b-eb96-4d53-8160-875bd2c1aaa9', 'c3413b7b-afb0-46ac-b8ae-3a698c53be06', '80ff8e86-4b1e-4c29-b5f9-7f4751273793'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:24 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:24 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:25 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:25 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:25 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Deleted volume successfully.
Apr 09 13:39:25 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-4e76fe21-62f2-41f1-aa0c-e447da8fbe05 tempest-VolumesSnapshotListTestJSON-778088156 None] Lock "cinder-48589869-3486-4da9-aeee-0b349ceb3148-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (b0955136-ec7e-49be-aa27-5cfe72f5646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fc9a63-7b4c-4296-a5a6-3180f3790a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fc9a63-7b4c-4296-a5a6-3180f3790a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479956282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ecda7c-4824-462b-ad6b-9441d2b5f24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:27Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f83ee8-e51b-4581-a2ad-c3467a02f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f83ee8-e51b-4581-a2ad-c3467a02f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a190b8c-3aa0-44ef-95fb-b42647491d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a190b8c-3aa0-44ef-95fb-b42647491d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ecda7c-4824-462b-ad6b-9441d2b5f24d', 'volume_name': 'volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8563c1-d33d-48f1-a568-c481e0801db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8563c1-d33d-48f1-a568-c481e0801db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5098a97-28c4-442d-84fc-e7df907f5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume 83ecda7c-4824-462b-ad6b-9441d2b5f24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d', 'volume_size': 1}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479956282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ecda7c-4824-462b-ad6b-9441d2b5f24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:27Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume 83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:26 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:26 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d 1073741824
Apr 09 13:39:26 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:27 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d 1073741824" returned: 0 in 0.471s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:27 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d
Apr 09 13:39:27 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:27 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d" returned: 0 in 0.404s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5098a97-28c4-442d-84fc-e7df907f5064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9732eeac-3767-47f3-8d62-6cb157e65dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:27 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d (83ecda7c-4824-462b-ad6b-9441d2b5f24d): created successfully
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9732eeac-3767-47f3-8d62-6cb157e65dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (b0955136-ec7e-49be-aa27-5cfe72f5646c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0b064070-e0a3-4426-9f76-8a478de2e86c tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating offline snapshot 0a05c27f-a41f-40f0-9e29-e70859fba908 of volume 83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[90387c64-d823-4694-ba8f-2d208e8fcb61]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:27 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d
Apr 09 13:39:27 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:28 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:28 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 1G
Apr 09 13:39:28 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:28 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 1G" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:28 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908
Apr 09 13:39:28 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:29 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908" returned: 0 in 0.429s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:29 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 is being set with open permissions: ugo+rw
Apr 09 13:39:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:29 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908
Apr 09 13:39:29 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:29 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908" returned: 0 in 0.402s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:29 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info
Apr 09 13:39:29 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:30 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info" returned: 0 in 0.411s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:30 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info is being set with open permissions: ugo+rw
Apr 09 13:39:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:30 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info
Apr 09 13:39:30 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:30 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.info" returned: 0 in 0.402s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-089574b1-716a-4bc1-ade9-19548d67c331 tempest-CreateVolumesFromSnapshotTest-586418455 None] Create snapshot completed successfully
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (4de15bb5-afff-4cbc-a079-c676b356dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef42de1b-e764-4c25-880d-e42e8635facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef42de1b-e764-4c25-880d-e42e8635facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169738022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e3bfa4-202a-4d91-afc0-8739df02bd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d148a4fa-2f51-4a83-9733-1eb786a2bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d148a4fa-2f51-4a83-9733-1eb786a2bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa503d7-45f9-4b84-ab16-ef3de1991266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa503d7-45f9-4b84-ab16-ef3de1991266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e3bfa4-202a-4d91-afc0-8739df02bd71', 'volume_name': 'volume-97e3bfa4-202a-4d91-afc0-8739df02bd71', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6e2798-7554-41ee-acd9-99abf052040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6e2798-7554-41ee-acd9-99abf052040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10816450-dd2b-4e05-a481-9106d35c930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume 97e3bfa4-202a-4d91-afc0-8739df02bd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e3bfa4-202a-4d91-afc0-8739df02bd71', 'volume_size': 1}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169738022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e3bfa4-202a-4d91-afc0-8739df02bd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume 97e3bfa4-202a-4d91-afc0-8739df02bd71 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:31 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:31 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 1073741824
Apr 09 13:39:31 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (6b210ea4-1fbd-4102-98aa-f165533fcafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58beabc0-5b12-4765-b9b0-a188fe7efa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58beabc0-5b12-4765-b9b0-a188fe7efa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661319285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bc8d46-0daa-4d83-a694-5553780d9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d35301-3bbe-4e1a-9ff6-56acb3dcdfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d35301-3bbe-4e1a-9ff6-56acb3dcdfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29e1ebd-7c3b-43ea-85a3-b85881fb6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29e1ebd-7c3b-43ea-85a3-b85881fb6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bc8d46-0daa-4d83-a694-5553780d9c59', 'volume_name': 'volume-c6bc8d46-0daa-4d83-a694-5553780d9c59', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061c558d-c58f-423c-8242-20e53b510543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061c558d-c58f-423c-8242-20e53b510543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b5fd2-dc75-4a70-8069-324208311848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume c6bc8d46-0daa-4d83-a694-5553780d9c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bc8d46-0daa-4d83-a694-5553780d9c59', 'volume_size': 1}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (f1ef8381-9667-49b4-9eac-0db9863fedc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8557972b-c96f-42df-9208-360c99621441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8557972b-c96f-42df-9208-360c99621441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810542655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d09e6d4-d989-4ab1-a5ba-125218ab78c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac75de5-c551-4171-92a5-d8ea5299fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac75de5-c551-4171-92a5-d8ea5299fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb3ad28-faef-4223-9612-523a9a361582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb3ad28-faef-4223-9612-523a9a361582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d09e6d4-d989-4ab1-a5ba-125218ab78c6', 'volume_name': 'volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a62b82-e9ab-4aee-8a09-3d066a630f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a62b82-e9ab-4aee-8a09-3d066a630f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a1bf26-d5b9-4f8f-91c5-f2855a47dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume 7d09e6d4-d989-4ab1-a5ba-125218ab78c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6', 'volume_size': 1}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:31 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (7ab3b59b-1ebe-446a-af7e-b8011b5156d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2844e9c8-c60e-4962-8d4e-516a598b977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 1073741824" returned: 0 in 0.584s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2844e9c8-c60e-4962-8d4e-516a598b977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950424245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ac02b-427b-4265-9fca-c2c9257289b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234e68d9-ed5e-4d83-9225-afb14410e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234e68d9-ed5e-4d83-9225-afb14410e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541c84b4-a23f-4175-96eb-2f77201f2caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541c84b4-a23f-4175-96eb-2f77201f2caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641ac02b-427b-4265-9fca-c2c9257289b9', 'volume_name': 'volume-641ac02b-427b-4265-9fca-c2c9257289b9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2584ff-b2e3-42c1-8dc5-b6e65e70bb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2584ff-b2e3-42c1-8dc5-b6e65e70bb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d66191-00dd-4c4f-89d0-49eb1fc91000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume 641ac02b-427b-4265-9fca-c2c9257289b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641ac02b-427b-4265-9fca-c2c9257289b9', 'volume_size': 1}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:31 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71
Apr 09 13:39:31 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (0aef336d-c43a-43fb-962d-79ad699d10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a67f7-3f90-4cd2-a47e-3501db7c4032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a67f7-3f90-4cd2-a47e-3501db7c4032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133256611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c1af42-541c-495b-a763-a49fe4795a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda94bcd-cc71-4cb1-9402-98dc4a0573f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda94bcd-cc71-4cb1-9402-98dc4a0573f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357b9a4-5b60-49f8-b46b-26319f93f3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:31 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357b9a4-5b60-49f8-b46b-26319f93f3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c1af42-541c-495b-a763-a49fe4795a43', 'volume_name': 'volume-c3c1af42-541c-495b-a763-a49fe4795a43', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b30fe-7799-4443-a1c6-72833a8afe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b30fe-7799-4443-a1c6-72833a8afe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8b759a-678a-4b04-b1f0-67ccf47f2841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume c3c1af42-541c-495b-a763-a49fe4795a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c1af42-541c-495b-a763-a49fe4795a43', 'volume_size': 1}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:32 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71" returned: 0 in 0.433s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661319285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bc8d46-0daa-4d83-a694-5553780d9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume c6bc8d46-0daa-4d83-a694-5553780d9c59 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:32 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10816450-dd2b-4e05-a481-9106d35c930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e3bfa4-202a-4d91-afc0-8739df02bd71', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac52262a-f2d0-4aaa-aca6-0538808fa934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:32 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 1073741824
Apr 09 13:39:32 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 (97e3bfa4-202a-4d91-afc0-8739df02bd71): created successfully
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac52262a-f2d0-4aaa-aca6-0538808fa934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (4de15bb5-afff-4cbc-a079-c676b356dd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:32 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4622f67a-850e-430f-a773-8cf44102efa4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:32 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 1073741824" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:32 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59
Apr 09 13:39:32 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:33 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59" returned: 0 in 0.405s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810542655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d09e6d4-d989-4ab1-a5ba-125218ab78c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume 7d09e6d4-d989-4ab1-a5ba-125218ab78c6 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:33 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b5fd2-dc75-4a70-8069-324208311848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bc8d46-0daa-4d83-a694-5553780d9c59', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecfddc2-365e-40ee-b3ed-f99e1af5910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:33 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 1073741824
Apr 09 13:39:33 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 (c6bc8d46-0daa-4d83-a694-5553780d9c59): created successfully
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecfddc2-365e-40ee-b3ed-f99e1af5910b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (6b210ea4-1fbd-4102-98aa-f165533fcafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1765c3d4-f302-4781-b994-2c8f4298e28a tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:33 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 1073741824" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:33 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6
Apr 09 13:39:33 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:34 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" returned: 0 in 0.408s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.250s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950424245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ac02b-427b-4265-9fca-c2c9257289b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume 641ac02b-427b-4265-9fca-c2c9257289b9 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:34 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a1bf26-d5b9-4f8f-91c5-f2855a47dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d0e32c-0a71-42d5-b947-836a37384bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:34 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 1073741824
Apr 09 13:39:34 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:34 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 (7d09e6d4-d989-4ab1-a5ba-125218ab78c6): created successfully
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d0e32c-0a71-42d5-b947-836a37384bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (f1ef8381-9667-49b4-9eac-0db9863fedc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:34 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-221d508a-607f-474f-b46d-c92d6f730c76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:34 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 1073741824" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:34 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9
Apr 09 13:39:34 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:35 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133256611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c1af42-541c-495b-a763-a49fe4795a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b809630e0d4f3fbfe2f2d0d63ebab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:32Z,use_quota=True,user_id='2c308c26df954f7097af80d0224881c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Creating volume c3c1af42-541c-495b-a763-a49fe4795a43 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:35 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d66191-00dd-4c4f-89d0-49eb1fc91000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641ac02b-427b-4265-9fca-c2c9257289b9', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854a3a1-b7dc-4ec3-b9f1-757dcbb2ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:35 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 1073741824
Apr 09 13:39:35 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:35 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-641ac02b-427b-4265-9fca-c2c9257289b9 (641ac02b-427b-4265-9fca-c2c9257289b9): created successfully
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854a3a1-b7dc-4ec3-b9f1-757dcbb2ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (7ab3b59b-1ebe-446a-af7e-b8011b5156d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0bbcc531-9b98-483e-9649-cc847708536b tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:35 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 1073741824" returned: 0 in 0.496s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:35 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43
Apr 09 13:39:35 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:35 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43" returned: 0 in 0.409s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8b759a-678a-4b04-b1f0-67ccf47f2841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c1af42-541c-495b-a763-a49fe4795a43', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee188d7-0d14-4392-86f3-a7ee1c7677e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:35 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Volume volume-c3c1af42-541c-495b-a763-a49fe4795a43 (c3c1af42-541c-495b-a763-a49fe4795a43): created successfully
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee188d7-0d14-4392-86f3-a7ee1c7677e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:35 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Flow 'volume_create_manager' (0aef336d-c43a-43fb-962d-79ad699d10f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-520b0ffb-7d59-4ee9-b11c-02da5678467a tempest-CreateVolumesFromSnapshotTest-586418455 None] Created volume successfully.
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-c3c1af42-541c-495b-a763-a49fe4795a43-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-c3c1af42-541c-495b-a763-a49fe4795a43-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-c3c1af42-541c-495b-a763-a49fe4795a43" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-c3c1af42-541c-495b-a763-a49fe4795a43" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf531130-4af1-4e36-bbf3-d7d86c8368b9]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:36 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43
Apr 09 13:39:36 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:36 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43" returned: 0 in 0.475s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:36 devstack sudo[89799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43
Apr 09 13:39:36 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:37 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c3c1af42-541c-495b-a763-a49fe4795a43" returned: 0 in 0.391s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-c3c1af42-541c-495b-a763-a49fe4795a43" released by "delete_volume" :: held 0.887s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['4656da2e-7735-446a-8c5f-a59628cde72e', 'd8151bf2-a53b-4f5a-8a05-28281a0ebb43', '787cfadc-9872-413d-b847-16fb2dc38f7d', '015e5209-f483-4b36-b765-163b611ff2eb'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:37 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:37 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-641ac02b-427b-4265-9fca-c2c9257289b9-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-641ac02b-427b-4265-9fca-c2c9257289b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-641ac02b-427b-4265-9fca-c2c9257289b9" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-641ac02b-427b-4265-9fca-c2c9257289b9" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6746ffc4-56d9-42e1-9c4b-ef23d4fc87d6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:37 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9
Apr 09 13:39:37 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:37 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:37 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-590382e3-23f4-4aba-b3ad-0f5274a5bb76 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-c3c1af42-541c-495b-a763-a49fe4795a43-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:38 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:38 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9
Apr 09 13:39:38 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:38 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-641ac02b-427b-4265-9fca-c2c9257289b9" returned: 0 in 0.411s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-641ac02b-427b-4265-9fca-c2c9257289b9" released by "delete_volume" :: held 0.925s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['288d2dc6-818c-477c-bf75-d3481b6732f1', 'fb33abc6-037a-4d93-b4da-3eb7c4949ae8', '85cad19e-de99-426c-a98e-3484965c0381', '316eb6ee-4f7a-419e-b396-eaa5f8e7b177'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:38 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:38 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-7d09e6d4-d989-4ab1-a5ba-125218ab78c6-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-7d09e6d4-d989-4ab1-a5ba-125218ab78c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" acquired by "delete_volume" :: waited 0.021s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3087c6-fc80-4855-9e1a-91753748d7f2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:38 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6
Apr 09 13:39:38 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:38 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.432s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:38 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-1f0fb85a-b22a-49fa-988a-7efa8251c90d tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-641ac02b-427b-4265-9fca-c2c9257289b9-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:39 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" returned: 0 in 0.484s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:39 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6
Apr 09 13:39:39 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:39 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-7d09e6d4-d989-4ab1-a5ba-125218ab78c6" released by "delete_volume" :: held 0.911s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['9e73c251-14ae-43c8-8860-6dca554beba1', 'ac70ba9e-0aac-46d5-a1fb-3d146250f88b', 'a58158ad-cbf9-4a0e-82ec-19e0f9c302e8', 'f30ca53d-1fd2-4d77-bc6b-269b4a69fc0e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:39 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:39 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-c6bc8d46-0daa-4d83-a694-5553780d9c59-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-c6bc8d46-0daa-4d83-a694-5553780d9c59-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-c6bc8d46-0daa-4d83-a694-5553780d9c59" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-c6bc8d46-0daa-4d83-a694-5553780d9c59" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe736bc-2070-4f3a-a5f5-cb1e79cad04d]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:39 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59
Apr 09 13:39:39 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:40 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:40 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=138,cinder:INSERT=39,cinder:UPDATE=152,cinder:DELETE=17 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2bbdc60b-30f7-4cf0-adbc-401d1adc2dab tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-7d09e6d4-d989-4ab1-a5ba-125218ab78c6-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:40 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:40 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59
Apr 09 13:39:40 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:40 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c6bc8d46-0daa-4d83-a694-5553780d9c59" returned: 0 in 0.404s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-c6bc8d46-0daa-4d83-a694-5553780d9c59" released by "delete_volume" :: held 0.906s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=105,cinder:INSERT=40,cinder:UPDATE=160,cinder:DELETE=9 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['ce5fb439-0f71-4c67-95f1-f8ea79daa918', '2cef1a12-bef3-4b6d-83a4-61e9aca1f3bd', '1f25178a-162a-4f33-9012-92e409b00a8e', '450737f9-4906-4e78-aa3b-cbf93d0181e8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:40 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:40 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-97e3bfa4-202a-4d91-afc0-8739df02bd71-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-97e3bfa4-202a-4d91-afc0-8739df02bd71-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-97e3bfa4-202a-4d91-afc0-8739df02bd71" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-97e3bfa4-202a-4d91-afc0-8739df02bd71" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc3e49-2a39-463f-869a-f25fba19f5bb]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:40 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71
Apr 09 13:39:40 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:41 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.433s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a9ee283d-4121-4855-bbc1-93f212020d1a tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-c6bc8d46-0daa-4d83-a694-5553780d9c59-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:41 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71" returned: 0 in 0.459s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:41 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71
Apr 09 13:39:41 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:41 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-97e3bfa4-202a-4d91-afc0-8739df02bd71" returned: 0 in 0.409s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-97e3bfa4-202a-4d91-afc0-8739df02bd71" released by "delete_volume" :: held 0.893s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['7ed0379d-e5f2-406d-86ca-7851769491bb', 'e0418298-52c0-4478-b90e-ad323d55dc9a', 'f28bc40f-d7e6-44f9-8806-6a0356ef97bf', 'dabd6305-bd98-4e62-a5d1-2896a556f361'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:41 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:41 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-0a05c27f-a41f-40f0-9e29-e70859fba908-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-0a05c27f-a41f-40f0-9e29-e70859fba908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-0a05c27f-a41f-40f0-9e29-e70859fba908" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-0a05c27f-a41f-40f0-9e29-e70859fba908" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleting offline snapshot 0a05c27f-a41f-40f0-9e29-e70859fba908 of volume 83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] snapshot_file for this snap is: volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611c3d8-df5c-4931-bb27-2466d521d657]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:42 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908
Apr 09 13:39:42 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:42 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.434s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-68c208c6-85fe-4949-a663-b69cdc78caf4 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-97e3bfa4-202a-4d91-afc0-8739df02bd71-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:42 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60589ff-afe5-43b6-9931-ba6d52253ee0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:42 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d
Apr 09 13:39:42 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:42 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d" returned: 0 in 0.465s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:42 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908
Apr 09 13:39:42 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:43 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908" returned: 0 in 0.432s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:43 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908
Apr 09 13:39:43 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:43 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d.0a05c27f-a41f-40f0-9e29-e70859fba908" returned: 0 in 0.391s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-0a05c27f-a41f-40f0-9e29-e70859fba908" released by "_delete_snapshot" :: held 1.794s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" released by "delete_snapshot" :: held 1.805s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['c3cacef8-bbf7-400a-b695-a4a75464caf0', '937e4ef8-c72b-40c2-8f03-d1fdb161ff27', '3f235952-2ce8-4c09-a939-57c52bd7e04d', '0c487790-ff90-4267-a84b-5d93253b0d69'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:43 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Delete snapshot completed successfully.
Apr 09 13:39:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66059a8-66d3-40db-8150-684478cb047c tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-0a05c27f-a41f-40f0-9e29-e70859fba908-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-83ecda7c-4824-462b-ad6b-9441d2b5f24d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-83ecda7c-4824-462b-ad6b-9441d2b5f24d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b680d06-9a41-4501-b20e-84abb941b3dc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:44 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d
Apr 09 13:39:44 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:44 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:44 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d
Apr 09 13:39:44 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:44 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-83ecda7c-4824-462b-ad6b-9441d2b5f24d" returned: 0 in 0.403s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-quobyte-83ecda7c-4824-462b-ad6b-9441d2b5f24d" released by "delete_volume" :: held 0.886s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Created reservations ['a5ebaa35-3cca-426e-a398-d6fff932bce7', '393d6b99-a52d-403a-b344-300f15a997ad', 'e76bcbc7-96fb-4276-a3bf-817b6730d2b9', '9fc795bd-fdfc-4bb4-8906-24cbf19700ad'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:45 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:45 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:45 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.468s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:45 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Deleted volume successfully.
Apr 09 13:39:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7affb74b-6f86-4540-970c-ca92b35611a8 tempest-CreateVolumesFromSnapshotTest-586418455 None] Lock "cinder-83ecda7c-4824-462b-ad6b-9441d2b5f24d-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (4df531c3-c58d-4fcc-8acc-179930131086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ac4d80-7ba2-46a8-abd7-f4e7197aab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ac4d80-7ba2-46a8-abd7-f4e7197aab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602499674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212019d2-2068-484b-92f1-8cf758707c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:47Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6599da-752f-442d-abbb-9585e24b819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6599da-752f-442d-abbb-9585e24b819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82626d5d-f686-4427-95ca-acd0a540b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82626d5d-f686-4427-95ca-acd0a540b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212019d2-2068-484b-92f1-8cf758707c8e', 'volume_name': 'volume-212019d2-2068-484b-92f1-8cf758707c8e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f3fc1-7e3c-4fda-85bf-b5c0317b928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f3fc1-7e3c-4fda-85bf-b5c0317b928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0278087b-9765-41be-8044-8c5a481c67f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:46 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Volume 212019d2-2068-484b-92f1-8cf758707c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212019d2-2068-484b-92f1-8cf758707c8e', 'volume_size': 1}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602499674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212019d2-2068-484b-92f1-8cf758707c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:47Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Creating volume 212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:46 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:46 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e 1073741824
Apr 09 13:39:46 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:47 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e 1073741824" returned: 0 in 0.456s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:47 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:47 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:47 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.403s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0278087b-9765-41be-8044-8c5a481c67f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212019d2-2068-484b-92f1-8cf758707c8e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd019bc-96e7-40b7-9bc1-486b5761aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:47 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Volume volume-212019d2-2068-484b-92f1-8cf758707c8e (212019d2-2068-484b-92f1-8cf758707c8e): created successfully
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd019bc-96e7-40b7-9bc1-486b5761aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (4df531c3-c58d-4fcc-8acc-179930131086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3b72d51f-8197-4b5f-b335-c2f7de770e37 tempest-VolumeDependencyTests-71956733 None] Created volume successfully.
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Creating offline snapshot 1e321695-6af2-4329-b61f-7e9ec0e5b9d7 of volume 212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bb2a4d-d8ee-461a-9de8-adeea37099b5]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:48 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:48 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:48 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:48 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 1G
Apr 09 13:39:48 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:48 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 1G" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212019d2-2068-484b-92f1-8cf758707c8e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:48 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212019d2-2068-484b-92f1-8cf758707c8e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:48 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:49 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212019d2-2068-484b-92f1-8cf758707c8e -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.417s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:49 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 is being set with open permissions: ugo+rw
Apr 09 13:39:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:49 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:49 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:49 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.397s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:49 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info
Apr 09 13:39:49 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:50 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:50 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info is being set with open permissions: ugo+rw
Apr 09 13:39:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:50 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info
Apr 09 13:39:50 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:50 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.info" returned: 0 in 0.403s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-169aad78-b3c8-45e4-a036-f2e3d00a7862 tempest-VolumeDependencyTests-71956733 None] Create snapshot completed successfully
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (284b2d95-1109-4e55-85fa-b3d7111f5f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011fb758-882e-4152-aca8-0b25264ebd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011fb758-882e-4152-aca8-0b25264ebd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1755085877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad984691-d66c-44c1-b5da-38bbf79f9ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e321695-6af2-4329-b61f-7e9ec0e5b9d7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:51Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab9134e-cbb2-4ab0-8470-34b20791ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab9134e-cbb2-4ab0-8470-34b20791ff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670ac50-ca52-4afd-83f4-af6a9b048dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670ac50-ca52-4afd-83f4-af6a9b048dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad984691-d66c-44c1-b5da-38bbf79f9ecb', 'volume_name': 'volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb', 'volume_size': 1, 'snapshot_id': '1e321695-6af2-4329-b61f-7e9ec0e5b9d7'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401500f9-5b88-4c0b-8fbb-1ebc89d94461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401500f9-5b88-4c0b-8fbb-1ebc89d94461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d613331c-3ef7-4d0c-b764-3c6fd90caf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:51 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Volume ad984691-d66c-44c1-b5da-38bbf79f9ecb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb', 'volume_size': 1, 'snapshot_id': '1e321695-6af2-4329-b61f-7e9ec0e5b9d7'}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-ad984691-d66c-44c1-b5da-38bbf79f9ecb" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-ad984691-d66c-44c1-b5da-38bbf79f9ecb" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Creating volume ad984691-d66c-44c1-b5da-38bbf79f9ecb from snapshot 1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] snapshot: 1e321695-6af2-4329-b61f-7e9ec0e5b9d7, volume: ad984691-d66c-44c1-b5da-38bbf79f9ecb,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5265e4-5268-41fa-8cb7-fd522e50707f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:51 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:51 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:51 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-212019d2-2068-484b-92f1-8cf758707c8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d12d0-4fb8-4596-a0e5-dc33eb3f0512]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:52 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:52 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:52 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:52 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:39:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:52 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb
Apr 09 13:39:52 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:54 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb" returned: 0 in 1.745s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3436559e-17f9-451e-a816-e7e80f1fc324]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:54 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:54 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:54 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.594s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e, size 1024.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:39:54 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Converted 1024.00 MB image at 586.38 MB/s
Apr 09 13:39:54 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb is being set with open permissions: ugo+rw
Apr 09 13:39:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:54 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb
Apr 09 13:39:54 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:55 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb" returned: 0 in 0.396s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" released by "_copy_volume_from_snapshot" :: held 3.715s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-ad984691-d66c-44c1-b5da-38bbf79f9ecb" released by "_create_volume_from_snapshot" :: held 3.731s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.739s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d613331c-3ef7-4d0c-b764-3c6fd90caf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb', 'volume_size': 1, 'snapshot_id': '1e321695-6af2-4329-b61f-7e9ec0e5b9d7'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e394db-005e-431a-96ff-a6d7515ff423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:55 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Volume volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb (ad984691-d66c-44c1-b5da-38bbf79f9ecb): created successfully
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e394db-005e-431a-96ff-a6d7515ff423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (284b2d95-1109-4e55-85fa-b3d7111f5f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-045acf86-adb9-443a-85de-e1aa6964e525 tempest-VolumeDependencyTests-71956733 None] Created volume successfully.
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Deleting offline snapshot 1e321695-6af2-4329-b61f-7e9ec0e5b9d7 of volume 212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] snapshot_file for this snap is: volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fc89d-6df6-472c-9b70-ab7111491c5b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:55 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:55 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:56 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-212019d2-2068-484b-92f1-8cf758707c8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54084b-e0d5-4c55-a369-f2ba52261da6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:56 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:56 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:56 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.475s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:56 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:56 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:57 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:57 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7
Apr 09 13:39:57 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:57 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e.1e321695-6af2-4329-b61f-7e9ec0e5b9d7" returned: 0 in 0.401s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-1e321695-6af2-4329-b61f-7e9ec0e5b9d7" released by "_delete_snapshot" :: held 1.837s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" released by "delete_snapshot" :: held 1.850s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Created reservations ['383065e0-f898-4af7-bbab-2e67fe2bd511', '6d1e9b75-bff1-4378-8471-586f618f53b6', 'bb0dd3e9-80c4-4938-8038-2625e4191003', 'b99819b4-b44d-4f03-bd53-c210553ba70b'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:57 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Delete snapshot completed successfully.
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-42a7d9d1-be59-4843-bf53-20a7cd3ed046 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-1e321695-6af2-4329-b61f-7e9ec0e5b9d7-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-212019d2-2068-484b-92f1-8cf758707c8e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "cinder-212019d2-2068-484b-92f1-8cf758707c8e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e34278-a877-4749-bb55-928ee44af284]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:39:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:57 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:57 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:58 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.473s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:58 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e
Apr 09 13:39:58 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:58 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-212019d2-2068-484b-92f1-8cf758707c8e" returned: 0 in 0.393s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-212019d2-2068-484b-92f1-8cf758707c8e" released by "delete_volume" :: held 0.897s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Created reservations ['7918cbf6-2e1d-4c7f-8f8c-f6cc6b26a741', '78b59c93-3b80-4faa-b856-5ed09627ddbb', '8ceb32cb-a120-4785-9f4d-0abb45abfdd5', '8ec5a204-e182-4c99-967d-1dea209ce78f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:58 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:39:58 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (ce165e8d-400b-47e3-8578-fa1de341ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b8185b-a656-48c2-bf5e-119f609e227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b8185b-a656-48c2-bf5e-119f609e227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123775339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f322460-ac15-4e77-b5bd-34496dfa8132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:59Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefbf974-74e4-4155-a4bd-662e20cdd4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefbf974-74e4-4155-a4bd-662e20cdd4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eff5cf-c5eb-4fea-89e3-34fb133b0164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eff5cf-c5eb-4fea-89e3-34fb133b0164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f322460-ac15-4e77-b5bd-34496dfa8132', 'volume_name': 'volume-2f322460-ac15-4e77-b5bd-34496dfa8132', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff00da4b-619c-412f-8856-5ba695307c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff00da4b-619c-412f-8856-5ba695307c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c29d49-84e3-4c77-9dc6-1b98ec4833c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:39:59 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Volume 2f322460-ac15-4e77-b5bd-34496dfa8132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f322460-ac15-4e77-b5bd-34496dfa8132', 'volume_size': 1}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123775339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f322460-ac15-4e77-b5bd-34496dfa8132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:59Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Creating volume 2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:39:59 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:59 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 1073741824
Apr 09 13:39:59 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:39:59 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.430s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:39:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Deleted volume successfully.
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-276f9c47-a96f-4c70-8040-3632778d353d tempest-VolumeDependencyTests-71956733 None] Lock "cinder-212019d2-2068-484b-92f1-8cf758707c8e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:39:59 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 1073741824" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:39:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:39:59 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:39:59 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:00 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.406s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c29d49-84e3-4c77-9dc6-1b98ec4833c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f322460-ac15-4e77-b5bd-34496dfa8132', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c796c2-be6f-4cf5-b4fd-6e9576069859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:00 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Volume volume-2f322460-ac15-4e77-b5bd-34496dfa8132 (2f322460-ac15-4e77-b5bd-34496dfa8132): created successfully
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c796c2-be6f-4cf5-b4fd-6e9576069859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (ce165e8d-400b-47e3-8578-fa1de341ef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5047b438-a77f-41ca-a075-2e20a814b8dd tempest-VolumeDependencyTests-71956733 None] Created volume successfully.
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (478c069f-ad30-4a4d-838e-c130d9e1103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8a518f-8824-4282-88ab-d9b8ad6d8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8a518f-8824-4282-88ab-d9b8ad6d8023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1614100611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c69c70-2779-48fe-ba63-181369faf1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf68dbcc75d40db9192dd43b98a0c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2f322460-ac15-4e77-b5bd-34496dfa8132,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:01Z,use_quota=True,user_id='28e9028a60614c5b8384ec9ad000403f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfba233-0d1b-473c-bbe2-12fa4c0d7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfba233-0d1b-473c-bbe2-12fa4c0d7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fdd99c-88f5-4d3c-8a15-a16b15cce12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fdd99c-88f5-4d3c-8a15-a16b15cce12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f2c69c70-2779-48fe-ba63-181369faf1a5', 'volume_name': 'volume-f2c69c70-2779-48fe-ba63-181369faf1a5', 'volume_size': 1, 'source_volid': '2f322460-ac15-4e77-b5bd-34496dfa8132', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb14c0-e556-4c01-8b7c-9533225c44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb14c0-e556-4c01-8b7c-9533225c44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4454743-ca4f-424d-aede-3c9d65dd894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:01 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Volume f2c69c70-2779-48fe-ba63-181369faf1a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f2c69c70-2779-48fe-ba63-181369faf1a5', 'volume_size': 1, 'source_volid': '2f322460-ac15-4e77-b5bd-34496dfa8132', 'source_volstatus': 'available'}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:01 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Cloning volume 2f322460-ac15-4e77-b5bd-34496dfa8132 to volume f2c69c70-2779-48fe-ba63-181369faf1a5
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Creating offline snapshot 06b46742-6477-450a-8bef-19da1783ce5d of volume 2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc52d2-0de8-43d5-9106-9188f6da21e6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:01 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:01 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:02 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:02 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d 1G
Apr 09 13:40:02 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:02 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d 1G" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f322460-ac15-4e77-b5bd-34496dfa8132 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:02 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f322460-ac15-4e77-b5bd-34496dfa8132 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:02 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:02 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f322460-ac15-4e77-b5bd-34496dfa8132 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.405s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:02 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d is being set with open permissions: ugo+rw
Apr 09 13:40:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:02 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:02 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:03 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.389s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:03 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info
Apr 09 13:40:03 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:03 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:03 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info is being set with open permissions: ugo+rw
Apr 09 13:40:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:03 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info
Apr 09 13:40:03 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:04 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.info" returned: 0 in 0.391s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] snapshot: 06b46742-6477-450a-8bef-19da1783ce5d, volume: f2c69c70-2779-48fe-ba63-181369faf1a5,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea17bd-41f6-48b3-bcd5-661782859492]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:04 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:04 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:04 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f322460-ac15-4e77-b5bd-34496dfa8132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba1a0f-10a8-4a1d-bc45-b9214d4b945e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:04 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:04 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:05 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.455s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:05 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5
Apr 09 13:40:05 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:05 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:05 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:05 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.481s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:06 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5" returned: 0 in 1.853s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e2efd-a3f1-4bfc-884e-72dee146f2af]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:07 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:07 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:07 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.571s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:40:07 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Converted 1024.00 MB image at 552.48 MB/s
Apr 09 13:40:07 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 is being set with open permissions: ugo+rw
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:07 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5
Apr 09 13:40:07 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:07 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5" returned: 0 in 0.402s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" released by "_copy_volume_from_snapshot" :: held 3.784s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-06b46742-6477-450a-8bef-19da1783ce5d" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-06b46742-6477-450a-8bef-19da1783ce5d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Deleting offline snapshot 06b46742-6477-450a-8bef-19da1783ce5d of volume 2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] snapshot_file for this snap is: volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6995a60-19bc-44a3-9e92-c3171dae46da]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:08 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:08 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:08 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.462s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f322460-ac15-4e77-b5bd-34496dfa8132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ed895-21d7-4575-99b7-b7ea276dca74]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:08 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:08 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:08 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.467s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:08 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:08 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:09 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:09 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d
Apr 09 13:40:09 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:09 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132.06b46742-6477-450a-8bef-19da1783ce5d" returned: 0 in 0.405s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-06b46742-6477-450a-8bef-19da1783ce5d" released by "_delete_snapshot" :: held 1.817s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.228s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4454743-ca4f-424d-aede-3c9d65dd894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c69c70-2779-48fe-ba63-181369faf1a5', 'volume_size': 1, 'source_volid': '2f322460-ac15-4e77-b5bd-34496dfa8132', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b55a79c-e5d3-4ae6-8555-2b1706e2971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:09 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Volume volume-f2c69c70-2779-48fe-ba63-181369faf1a5 (f2c69c70-2779-48fe-ba63-181369faf1a5): created successfully
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b55a79c-e5d3-4ae6-8555-2b1706e2971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:09 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Flow 'volume_create_manager' (478c069f-ad30-4a4d-838e-c130d9e1103e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a3502345-36f4-4aa2-b59e-91173874038e tempest-VolumeDependencyTests-71956733 None] Created volume successfully.
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-2f322460-ac15-4e77-b5bd-34496dfa8132-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "cinder-2f322460-ac15-4e77-b5bd-34496dfa8132-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-2f322460-ac15-4e77-b5bd-34496dfa8132" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-2f322460-ac15-4e77-b5bd-34496dfa8132" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c2a205-b6d6-452d-b896-9258d8b3e133]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:10 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:10 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:10 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.463s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:10 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132
Apr 09 13:40:10 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:10 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2f322460-ac15-4e77-b5bd-34496dfa8132" returned: 0 in 0.397s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-2f322460-ac15-4e77-b5bd-34496dfa8132" released by "delete_volume" :: held 0.885s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Created reservations ['6a01beb9-5f3a-4345-bb7b-cf1c79bfeaaf', 'fd4ef4f9-6277-4698-8a3e-cc3bf1e0d348', '8196119a-64a9-4875-a3c0-63449e214ad7', '621f6058-c36b-481a-872d-6e2d4242e170'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:11 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:11 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-f2c69c70-2779-48fe-ba63-181369faf1a5-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-f2c69c70-2779-48fe-ba63-181369faf1a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[267881bb-3034-42a3-8d3e-d6f6dda1a393]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:11 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5
Apr 09 13:40:11 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:11 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.437s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:11 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Deleted volume successfully.
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-54113265-44ee-4648-89b5-95a94e25edce tempest-VolumeDependencyTests-71956733 None] Lock "cinder-2f322460-ac15-4e77-b5bd-34496dfa8132-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:11 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:11 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5
Apr 09 13:40:11 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:12 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f2c69c70-2779-48fe-ba63-181369faf1a5" returned: 0 in 0.401s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-f2c69c70-2779-48fe-ba63-181369faf1a5" released by "delete_volume" :: held 0.915s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Created reservations ['84d1eb2d-fff9-452b-9383-e534e293548f', '28871ab0-74d7-48b4-9071-3ea74c630647', '91eee00c-76d6-44fc-88b8-2070dfcc5aea', '8084240d-ae01-4717-84ad-62ae05c36c56'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:12 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:12 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-ad984691-d66c-44c1-b5da-38bbf79f9ecb-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "cinder-ad984691-d66c-44c1-b5da-38bbf79f9ecb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Acquiring lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" acquired by "delete_volume" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[df83a5e2-f837-44a9-bb7e-b3778a6f45b5]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:12 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb
Apr 09 13:40:12 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:12 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Deleted volume successfully.
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7b229130-6df2-4ea1-bd78-fc6c39fbfdf7 tempest-VolumeDependencyTests-71956733 None] Lock "cinder-f2c69c70-2779-48fe-ba63-181369faf1a5-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:12 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb" returned: 0 in 0.468s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:12 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb
Apr 09 13:40:12 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:13 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-ad984691-d66c-44c1-b5da-38bbf79f9ecb" returned: 0 in 0.396s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "cinder-quobyte-ad984691-d66c-44c1-b5da-38bbf79f9ecb" released by "delete_volume" :: held 0.890s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Created reservations ['b3ef35f3-c425-441c-b543-3ce7fd82f8c0', 'd7f6cda8-f402-474f-8bc0-c5dd515ace9d', 'e9feb687-c49c-4974-a9e8-4a8a170aee08', '7e620c9d-089c-45df-8f66-4dfa99009640'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:13 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:13 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:13 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Deleted volume successfully.
Apr 09 13:40:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-aab756a2-18cd-405f-b5fe-30b1b11d9fec tempest-VolumeDependencyTests-71956733 None] Lock "cinder-ad984691-d66c-44c1-b5da-38bbf79f9ecb-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (405515e0-70d7-4ee1-9fb9-94f1be828df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f113fed-35ae-410f-9fc7-c455b83ae56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (967d7944-d8eb-46bc-8227-893976634a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776eb31-c291-441a-879d-c2acf736369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f113fed-35ae-410f-9fc7-c455b83ae56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250073020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:20Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e95537e-68eb-4286-b0f9-d289aa8ccaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e95537e-68eb-4286-b0f9-d289aa8ccaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985988f6-10e8-4108-9a69-cb80cfef84b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985988f6-10e8-4108-9a69-cb80cfef84b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a', 'volume_name': 'volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da0cf13-dc8b-474a-92f3-02571e59aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da0cf13-dc8b-474a-92f3-02571e59aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5233414a-6b66-4cd4-9606-1cc05fe9023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a', 'volume_size': 1}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250073020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:20Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:20 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776eb31-c291-441a-879d-c2acf736369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-999373031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e45533-6a04-42fa-9da3-9e6c1fbba5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:20Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a41c29-ff97-47ff-a459-3937d3d1c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a41c29-ff97-47ff-a459-3937d3d1c991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f782c4b-6806-4124-8588-bcb5dcfe6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f782c4b-6806-4124-8588-bcb5dcfe6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e45533-6a04-42fa-9da3-9e6c1fbba5fd', 'volume_name': 'volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc658c3-6bbe-408c-b132-91ac91cc2604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc658c3-6bbe-408c-b132-91ac91cc2604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d05aaf5-4f9d-437b-9205-a1abc8155a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Volume e3e45533-6a04-42fa-9da3-9e6c1fbba5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd', 'volume_size': 1}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:20 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a 1073741824
Apr 09 13:40:20 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (1b8c8064-7d5f-4bb3-941c-744b0fc4b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46002825-7af6-490d-bb8c-cdabf3cdbbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46002825-7af6-490d-bb8c-cdabf3cdbbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002081461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2747421b-9975-4344-a0ee-1ae073a0d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a143729-5e70-44c0-9ef9-77f9556e308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a143729-5e70-44c0-9ef9-77f9556e308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d0a35-2712-416e-99f4-ab1ab4f31c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d0a35-2712-416e-99f4-ab1ab4f31c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2747421b-9975-4344-a0ee-1ae073a0d282', 'volume_name': 'volume-2747421b-9975-4344-a0ee-1ae073a0d282', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44d7a4d-96c8-4087-bd10-bf90a7db9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44d7a4d-96c8-4087-bd10-bf90a7db9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d215d4-6692-43bc-85e1-fd2873ec32d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Volume 2747421b-9975-4344-a0ee-1ae073a0d282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2747421b-9975-4344-a0ee-1ae073a0d282', 'volume_size': 1}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (fc084947-8a30-43a1-8ca7-b702950dc315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7729484-a0a0-4fa8-8060-d014fa477de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7729484-a0a0-4fa8-8060-d014fa477de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697116651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f4ff22-822e-4141-b962-1775b9ae974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4fbf4c-41fa-4567-a25a-3cdbc3dd7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4fbf4c-41fa-4567-a25a-3cdbc3dd7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c93df4-8a38-434e-a470-c688cd0d8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c93df4-8a38-434e-a470-c688cd0d8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f4ff22-822e-4141-b962-1775b9ae974d', 'volume_name': 'volume-18f4ff22-822e-4141-b962-1775b9ae974d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa3341-82ed-4901-a25d-f11cb7f01be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa3341-82ed-4901-a25d-f11cb7f01be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f091add4-e1cd-4c87-a30f-0ce980dff8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:20 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Volume 18f4ff22-822e-4141-b962-1775b9ae974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f4ff22-822e-4141-b962-1775b9ae974d', 'volume_size': 1}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:20 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (7702b8b6-efab-4b03-9f0c-2771b53a17e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a03ed5-3e9d-4748-88f9-596eef2e0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a03ed5-3e9d-4748-88f9-596eef2e0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879520718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5638d72-8208-477d-9cdf-c968a4f32631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67fcec1-638c-4ad4-b444-aa8728db4997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67fcec1-638c-4ad4-b444-aa8728db4997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7f78fc-1bcc-4920-bf7d-d58ee35473c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7f78fc-1bcc-4920-bf7d-d58ee35473c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5638d72-8208-477d-9cdf-c968a4f32631', 'volume_name': 'volume-c5638d72-8208-477d-9cdf-c968a4f32631', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13653b5-14a9-4490-ae9f-9959c499ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13653b5-14a9-4490-ae9f-9959c499ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad283e-4f5d-461e-a42e-3283a4a554c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Volume c5638d72-8208-477d-9cdf-c968a4f32631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5638d72-8208-477d-9cdf-c968a4f32631', 'volume_size': 1}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (329db233-db9f-4f90-9afb-893ce7fbda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5677d2-770f-4df8-aba4-52beaf32862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5677d2-770f-4df8-aba4-52beaf32862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513602150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f02710-cb8a-4c7d-a808-2f69e215696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a82e57-a592-4988-9a79-ab863c28dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a82e57-a592-4988-9a79-ab863c28dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1ef0f0-9149-42af-8c68-3e73338d03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1ef0f0-9149-42af-8c68-3e73338d03f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f02710-cb8a-4c7d-a808-2f69e215696b', 'volume_name': 'volume-39f02710-cb8a-4c7d-a808-2f69e215696b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f2d47-5630-4091-8310-1d1030713884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f2d47-5630-4091-8310-1d1030713884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431d3d88-1fc9-4c34-a9b1-4930e095ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Volume 39f02710-cb8a-4c7d-a808-2f69e215696b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f02710-cb8a-4c7d-a808-2f69e215696b', 'volume_size': 1}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:21 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a 1073741824" returned: 0 in 0.737s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:21 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a
Apr 09 13:40:21 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (2d46f3ec-74f6-47fb-a96c-e45353803cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062eb18e-b310-485d-bd75-c930a2a1f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062eb18e-b310-485d-bd75-c930a2a1f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790730236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b5319-b753-4fc9-82a9-0e8b8f2f3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b5319-b753-4fc9-82a9-0e8b8f2f3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8971492-4e7c-463d-9931-02f83e557cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8971492-4e7c-463d-9931-02f83e557cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720', 'volume_name': 'volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5080ae1b-a85b-4547-a12d-ee8f89302cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5080ae1b-a85b-4547-a12d-ee8f89302cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cc15d8-2ada-47b9-96e2-19c8d136fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Volume 60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720', 'volume_size': 1}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:21 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-999373031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e45533-6a04-42fa-9da3-9e6c1fbba5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:20Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Creating volume e3e45533-6a04-42fa-9da3-9e6c1fbba5fd {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5233414a-6b66-4cd4-9606-1cc05fe9023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd 1073741824
Apr 09 13:40:21 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f5d3cc-23f0-462e-b825-3b4207d17c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a (36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a): created successfully
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f5d3cc-23f0-462e-b825-3b4207d17c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:21 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (405515e0-70d7-4ee1-9fb9-94f1be828df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-d0222de4-42c6-4304-901b-59c54ba1ffbd tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:22 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd 1073741824" returned: 0 in 0.520s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:22 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd
Apr 09 13:40:22 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:22 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" returned: 0 in 0.478s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002081461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2747421b-9975-4344-a0ee-1ae073a0d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Creating volume 2747421b-9975-4344-a0ee-1ae073a0d282 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:22 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d05aaf5-4f9d-437b-9205-a1abc8155a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:22 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 1073741824
Apr 09 13:40:22 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa179b-f9f8-480a-81b8-ad6a0038b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:22 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Volume volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd (e3e45533-6a04-42fa-9da3-9e6c1fbba5fd): created successfully
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa179b-f9f8-480a-81b8-ad6a0038b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:22 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (967d7944-d8eb-46bc-8227-893976634a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:22 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-933ef763-3920-4678-b21a-6e150dfd89af tempest-CreateVolumesFromImageTest-420833347 None] Created volume successfully.
Apr 09 13:40:23 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 1073741824" returned: 0 in 0.649s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:23 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282
Apr 09 13:40:23 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:24 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282" returned: 0 in 0.452s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697116651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f4ff22-822e-4141-b962-1775b9ae974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Creating volume 18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:24 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d215d4-6692-43bc-85e1-fd2873ec32d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2747421b-9975-4344-a0ee-1ae073a0d282', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2ec14-1580-4d0f-b0ee-b46aa05d7684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:24 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d 1073741824
Apr 09 13:40:24 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:24 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Volume volume-2747421b-9975-4344-a0ee-1ae073a0d282 (2747421b-9975-4344-a0ee-1ae073a0d282): created successfully
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2ec14-1580-4d0f-b0ee-b46aa05d7684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (1b8c8064-7d5f-4bb3-941c-744b0fc4b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:24 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2d37ac29-f293-4ae1-b3b1-997390020da1 tempest-CreateVolumesFromImageTest-420833347 None] Created volume successfully.
Apr 09 13:40:24 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d 1073741824" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:24 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:24 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:24 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:25 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.546s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.062s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879520718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5638d72-8208-477d-9cdf-c968a4f32631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Creating volume c5638d72-8208-477d-9cdf-c968a4f32631 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:25 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f091add4-e1cd-4c87-a30f-0ce980dff8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f4ff22-822e-4141-b962-1775b9ae974d', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a924a8c-a1ff-4080-a29f-4dbd82c3901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:25 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Volume volume-18f4ff22-822e-4141-b962-1775b9ae974d (18f4ff22-822e-4141-b962-1775b9ae974d): created successfully
Apr 09 13:40:25 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 1073741824
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a924a8c-a1ff-4080-a29f-4dbd82c3901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:25 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (fc084947-8a30-43a1-8ca7-b702950dc315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:25 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9a156b07-b603-4387-a82b-fdfb416dd2f5 tempest-VolumeDependencyTests-1008572340 None] Created volume successfully.
Apr 09 13:40:25 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 1073741824" returned: 0 in 0.578s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:25 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:25 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631
Apr 09 13:40:25 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:26 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.911s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513602150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f02710-cb8a-4c7d-a808-2f69e215696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Creating volume 39f02710-cb8a-4c7d-a808-2f69e215696b {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:26 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad283e-4f5d-461e-a42e-3283a4a554c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5638d72-8208-477d-9cdf-c968a4f32631', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf78cc2-265e-4636-ace5-4445622382a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:26 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b 1073741824
Apr 09 13:40:26 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:26 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Volume volume-c5638d72-8208-477d-9cdf-c968a4f32631 (c5638d72-8208-477d-9cdf-c968a4f32631): created successfully
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf78cc2-265e-4636-ace5-4445622382a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (7702b8b6-efab-4b03-9f0c-2771b53a17e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:26 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b38ab42d-6af1-46cf-9b1c-0839b1b693da tempest-CreateVolumesFromImageTest-420833347 None] Created volume successfully.
Apr 09 13:40:26 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b 1073741824" returned: 0 in 0.603s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:26 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:26 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b
Apr 09 13:40:26 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:27 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b" returned: 0 in 0.522s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.835s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790730236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b0a7f9ef4344108926c4188d4fe3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:21Z,use_quota=True,user_id='fd0914d24c4242fba01eaf4354f064ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Creating volume 60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:27 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431d3d88-1fc9-4c34-a9b1-4930e095ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f02710-cb8a-4c7d-a808-2f69e215696b', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:27 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 1073741824
Apr 09 13:40:27 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c4308d-bdd4-46e6-b017-582bb3e21c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:27 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Volume volume-39f02710-cb8a-4c7d-a808-2f69e215696b (39f02710-cb8a-4c7d-a808-2f69e215696b): created successfully
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c4308d-bdd4-46e6-b017-582bb3e21c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (329db233-db9f-4f90-9afb-893ce7fbda73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:27 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-9202019c-e4c7-4dc7-82b8-aba518fcd700 tempest-CreateVolumesFromImageTest-420833347 None] Created volume successfully.
Apr 09 13:40:27 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 1073741824" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:27 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:27 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720
Apr 09 13:40:27 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:28 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" returned: 0 in 0.434s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.635s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cc15d8-2ada-47b9-96e2-19c8d136fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb68e0b7-af5a-4119-9096-39936d385cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating offline snapshot e94adef6-2c92-4fa8-97ad-3235bc7ba719 of volume 36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[906c4053-8cc1-42d3-afb7-9065eab3b4c6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:28 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Volume volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 (60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720): created successfully
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb68e0b7-af5a-4119-9096-39936d385cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Flow 'volume_create_manager' (2d46f3ec-74f6-47fb-a96c-e45353803cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:28 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a1946d4f-b2af-4bff-b163-29365ffafdfe tempest-CreateVolumesFromImageTest-420833347 None] Created volume successfully.
Apr 09 13:40:28 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a
Apr 09 13:40:28 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:28 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" returned: 0 in 0.490s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:28 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:28 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 1G
Apr 09 13:40:28 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-quobyte-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74029b8-a09e-4a06-8293-7042a45716ae]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:29 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720
Apr 09 13:40:29 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:29 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 1G" returned: 0 in 0.545s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:29 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719
Apr 09 13:40:29 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:29 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" returned: 0 in 0.549s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:29 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720
Apr 09 13:40:29 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:29 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719" returned: 0 in 0.483s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:29 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 is being set with open permissions: ugo+rw
Apr 09 13:40:29 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:29 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719
Apr 09 13:40:29 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:30 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" returned: 0 in 0.462s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720" released by "delete_volume" :: held 1.033s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Created reservations ['5a532210-532b-4e19-85fa-7691f7d71ba7', 'e09ed055-d705-4bd4-89e2-33639a05b367', '61219274-8ba7-4387-b5af-0ab353bd0210', '20524ce9-e02a-4ebc-97d2-7e185702eaa8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:30 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:30 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:30 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:30 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info
Apr 09 13:40:30 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:30 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.498s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:30 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Deleted volume successfully.
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5c4b4119-2a2b-4091-9dd9-892c576af12e tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-60fbc9a1-b2c6-4eaa-8ed6-cd40965c5720-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:30 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info" returned: 0 in 0.512s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:30 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info is being set with open permissions: ugo+rw
Apr 09 13:40:30 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:30 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info
Apr 09 13:40:30 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-39f02710-cb8a-4c7d-a808-2f69e215696b-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-39f02710-cb8a-4c7d-a808-2f69e215696b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-quobyte-39f02710-cb8a-4c7d-a808-2f69e215696b" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-39f02710-cb8a-4c7d-a808-2f69e215696b" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:31 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.info" returned: 0 in 0.450s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.041s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[81103383-d956-4ae5-b49a-6fc1caa7d831]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.291s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Creating offline snapshot c990796a-119a-48e6-afca-5dd1b9c04c53 of volume 18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9beff55-3f10-440c-bf22-a80791401870]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:31 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1817bcfc-cde7-4c44-a742-ea453232829c tempest-CreateVolumesFromSnapshotTest-886311580 None] Create snapshot completed successfully
Apr 09 13:40:31 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b
Apr 09 13:40:31 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:31 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:31 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:31 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b" returned: 0 in 0.539s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:31 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:31 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b
Apr 09 13:40:31 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:32 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.587s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:32 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 1G
Apr 09 13:40:32 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (ad0d735c-edb9-4d31-976c-d3829d44a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34d4604-d812-4d0d-8dc2-379791f48d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34d4604-d812-4d0d-8dc2-379791f48d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459924607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636b6c0f-1f8b-4323-9c81-56e4577c390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:32Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51547ac8-69c9-49b0-befb-88d361ab7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51547ac8-69c9-49b0-befb-88d361ab7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463af75b-afbf-463f-bd60-8324f39081fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463af75b-afbf-463f-bd60-8324f39081fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636b6c0f-1f8b-4323-9c81-56e4577c390e', 'volume_name': 'volume-636b6c0f-1f8b-4323-9c81-56e4577c390e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b058c37-bf18-4bf5-afc9-f3792e945911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b058c37-bf18-4bf5-afc9-f3792e945911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db43e6-c386-4a76-86bc-03b1dcf1ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 636b6c0f-1f8b-4323-9c81-56e4577c390e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636b6c0f-1f8b-4323-9c81-56e4577c390e', 'volume_size': 1}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:32 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (b3a53895-9f73-4eb4-ac54-a0850fdc5ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bf50a1-ed85-4da3-81b7-ccfa393ca62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-39f02710-cb8a-4c7d-a808-2f69e215696b" returned: 0 in 0.789s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-39f02710-cb8a-4c7d-a808-2f69e215696b" released by "delete_volume" :: held 1.411s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bf50a1-ed85-4da3-81b7-ccfa393ca62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255542857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cff543-f802-45e6-a9d7-23690479c642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4750106-34cc-464b-b932-2dfd83f8a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4750106-34cc-464b-b932-2dfd83f8a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618c316d-edea-4f9a-b2ff-d51f39142abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618c316d-edea-4f9a-b2ff-d51f39142abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63cff543-f802-45e6-a9d7-23690479c642', 'volume_name': 'volume-63cff543-f802-45e6-a9d7-23690479c642', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84cad8d-e3bc-4691-8f1f-8e8ecb546412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84cad8d-e3bc-4691-8f1f-8e8ecb546412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae535f1-952d-42df-8efa-dbe2ab68ab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:32 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 63cff543-f802-45e6-a9d7-23690479c642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63cff543-f802-45e6-a9d7-23690479c642', 'volume_size': 1}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Created reservations ['8df2921a-0ad2-4949-a235-d45ce07d3317', '6f52fee3-6c7a-42e8-81a5-8b2ce3281236', 'a8fc18e9-80e3-4c07-9f6e-fad77141ec34', 'a867289e-ca86-475f-8334-8a9d865acf23'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:32 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 1G" returned: 0 in 0.891s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f4ff22-822e-4141-b962-1775b9ae974d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:32 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f4ff22-822e-4141-b962-1775b9ae974d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:32 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:32 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:32 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:32 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (f70f21ba-5e9b-4037-a260-820eedbea886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2a4617-80ec-4e36-9e8d-f5a1c962e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2a4617-80ec-4e36-9e8d-f5a1c962e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1371205033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51210bdf-ee49-4f87-8a45-d052056c46d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e42ce1-a1e1-43f0-8c09-fb735526252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e42ce1-a1e1-43f0-8c09-fb735526252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e84a19-3d6c-40cb-8154-f9ffd21e2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e84a19-3d6c-40cb-8154-f9ffd21e2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51210bdf-ee49-4f87-8a45-d052056c46d4', 'volume_name': 'volume-51210bdf-ee49-4f87-8a45-d052056c46d4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd71cae-cd10-4114-8f60-de3022ccd0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd71cae-cd10-4114-8f60-de3022ccd0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f454e544-62fb-43e5-b429-6cc1e0cf40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 51210bdf-ee49-4f87-8a45-d052056c46d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51210bdf-ee49-4f87-8a45-d052056c46d4', 'volume_size': 1}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (2e55e2eb-5e2e-488d-a042-650fab7829ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29047c-d4fa-471d-97b2-7cfd8b757491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29047c-d4fa-471d-97b2-7cfd8b757491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642645266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b460bf-16de-4067-aadd-f2c6da595cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd763d-dff2-4b57-bf8c-6d8b6e0f7723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd763d-dff2-4b57-bf8c-6d8b6e0f7723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78667b0f-33cd-4a5c-8418-188e299fac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78667b0f-33cd-4a5c-8418-188e299fac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b460bf-16de-4067-aadd-f2c6da595cda', 'volume_name': 'volume-25b460bf-16de-4067-aadd-f2c6da595cda', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3ec3f-6314-4f99-9b90-5cc4248230c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3ec3f-6314-4f99-9b90-5cc4248230c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1faea4c-bb56-452a-93cd-ead9b45c4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 25b460bf-16de-4067-aadd-f2c6da595cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b460bf-16de-4067-aadd-f2c6da595cda', 'volume_size': 1}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (1425a0eb-83fd-4963-849b-e1c0a3ddfd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9da7a52-034a-4c53-bd16-ff42d59d6fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-c5638d72-8208-477d-9cdf-c968a4f32631-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9da7a52-034a-4c53-bd16-ff42d59d6fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603769881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce40836-7a45-47a3-a35c-fb63bafc75e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1c84c-a076-4dff-a185-bce3e56fe88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1c84c-a076-4dff-a185-bce3e56fe88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e59964-3d1f-496d-b4d2-bb13302ba9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e59964-3d1f-496d-b4d2-bb13302ba9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce40836-7a45-47a3-a35c-fb63bafc75e4', 'volume_name': 'volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e042582a-d4b1-4935-a25b-31faa35fe533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e042582a-d4b1-4935-a25b-31faa35fe533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5fc68e-5c6a-4182-89ff-17df966ded14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:33 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume 1ce40836-7a45-47a3-a35c-fb63bafc75e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4', 'volume_size': 1}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:33 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-c5638d72-8208-477d-9cdf-c968a4f32631-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f4ff22-822e-4141-b962-1775b9ae974d -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.726s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:33 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 is being set with open permissions: ugo+rw
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-quobyte-c5638d72-8208-477d-9cdf-c968a4f32631" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:33 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:33 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-c5638d72-8208-477d-9cdf-c968a4f32631" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8cafd7-f2e0-40b4-bbb6-69b2f456a0ef]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:33 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631
Apr 09 13:40:33 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:33 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.895s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:33 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Deleted volume successfully.
Apr 09 13:40:33 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-6a46ed04-3bba-488f-adf9-0d45ecbd787b tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-39f02710-cb8a-4c7d-a808-2f69e215696b-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:34 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.518s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:34 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info
Apr 09 13:40:34 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:34 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631" returned: 0 in 0.590s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:34 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631
Apr 09 13:40:34 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:34 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info" returned: 0 in 0.579s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:34 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info is being set with open permissions: ugo+rw
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:34 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info
Apr 09 13:40:34 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:34 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-c5638d72-8208-477d-9cdf-c968a4f32631" returned: 0 in 0.574s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:34 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-c5638d72-8208-477d-9cdf-c968a4f32631" released by "delete_volume" :: held 1.188s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Created reservations ['13b0aec9-8e37-4527-b8fe-424a57860af5', '029bfd78-1af3-4cc4-8909-458132464316', 'd295ba91-0207-4886-985b-fc05a09bbb34', '589237b8-9e31-4d60-85c8-3654cf9195a9'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:35 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.info" returned: 0 in 0.414s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.786s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459924607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636b6c0f-1f8b-4323-9c81-56e4577c390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:32Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 636b6c0f-1f8b-4323-9c81-56e4577c390e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:35 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:35 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e 1073741824
Apr 09 13:40:35 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-254b2cd9-9679-4dc2-a48c-c274401d9cab tempest-VolumeDependencyTests-1008572340 None] Create snapshot completed successfully
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:35 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:35 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:35 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e 1073741824" returned: 0 in 0.501s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:35 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.425s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:35 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:35 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Deleted volume successfully.
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e4ffe3b2-e0b8-40cd-9810-71d84a29b4fa tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-c5638d72-8208-477d-9cdf-c968a4f32631-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:36 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e
Apr 09 13:40:36 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-2747421b-9975-4344-a0ee-1ae073a0d282-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-2747421b-9975-4344-a0ee-1ae073a0d282-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Flow 'volume_create_manager' (6e9e86c8-4368-4255-a8d7-fe1a933955fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274272c4-b925-4384-9a8d-6b19c2eacbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274272c4-b925-4384-9a8d-6b19c2eacbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1524285846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c92023-7083-4b6e-b929-715ef0fe85b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37889b2bca4844279293ceff8df31c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:36Z,use_quota=True,user_id='e38921e985c64d2fa95aa09bc04fbafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2016e10f-2d8d-44b0-a0bd-46d7b39b1652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2016e10f-2d8d-44b0-a0bd-46d7b39b1652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ae182b-9f3e-4d42-b8fa-077cb7c2b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ae182b-9f3e-4d42-b8fa-077cb7c2b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c92023-7083-4b6e-b929-715ef0fe85b5', 'volume_name': 'volume-49c92023-7083-4b6e-b929-715ef0fe85b5', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e958a8-f718-40ef-a1a0-caa07dd43a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e958a8-f718-40ef-a1a0-caa07dd43a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c826b4-f30e-4fd8-a4c9-38fb19a1b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Volume 49c92023-7083-4b6e-b929-715ef0fe85b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c92023-7083-4b6e-b929-715ef0fe85b5', 'volume_size': 1}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-quobyte-2747421b-9975-4344-a0ee-1ae073a0d282" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-2747421b-9975-4344-a0ee-1ae073a0d282" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f59d88-1ba5-4f4d-90e0-5f653f9cb6ee]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:36 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282
Apr 09 13:40:36 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:36 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e" returned: 0 in 0.473s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.717s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255542857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cff543-f802-45e6-a9d7-23690479c642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 63cff543-f802-45e6-a9d7-23690479c642 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:36 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db43e6-c386-4a76-86bc-03b1dcf1ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636b6c0f-1f8b-4323-9c81-56e4577c390e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47ec976-b132-4e6a-8ddc-3b107f01ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 1073741824
Apr 09 13:40:36 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-636b6c0f-1f8b-4323-9c81-56e4577c390e (636b6c0f-1f8b-4323-9c81-56e4577c390e): created successfully
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47ec976-b132-4e6a-8ddc-3b107f01ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (ad0d735c-edb9-4d31-976c-d3829d44a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:36 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-08209b86-56a8-4ad6-958a-550d17ccc908 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:36 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282" returned: 0 in 0.568s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:36 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282
Apr 09 13:40:36 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (7e9a03cf-0e26-4408-95a4-0963907de564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a74e5a-200b-484c-b7ff-95d6040c9468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a74e5a-200b-484c-b7ff-95d6040c9468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-943587474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96246a8-6784-483e-bc90-63da69c7898a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c990796a-119a-48e6-afca-5dd1b9c04c53,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:37Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983fdcf1-9fe2-4821-ba54-82a6fe989bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983fdcf1-9fe2-4821-ba54-82a6fe989bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015afaec-5686-4d0b-9169-2e3af7c9a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015afaec-5686-4d0b-9169-2e3af7c9a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b96246a8-6784-483e-bc90-63da69c7898a', 'volume_name': 'volume-b96246a8-6784-483e-bc90-63da69c7898a', 'volume_size': 1, 'snapshot_id': 'c990796a-119a-48e6-afca-5dd1b9c04c53'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b198381-f4dd-4ae4-a7e5-e9d99b0c2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b198381-f4dd-4ae4-a7e5-e9d99b0c2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a482db28-7eea-4891-8139-254b4307a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:36 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Volume b96246a8-6784-483e-bc90-63da69c7898a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b96246a8-6784-483e-bc90-63da69c7898a', 'volume_size': 1, 'snapshot_id': 'c990796a-119a-48e6-afca-5dd1b9c04c53'}
Apr 09 13:40:36 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:37 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 1073741824" returned: 0 in 0.536s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:37 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642
Apr 09 13:40:37 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:37 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-2747421b-9975-4344-a0ee-1ae073a0d282" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-2747421b-9975-4344-a0ee-1ae073a0d282" released by "delete_volume" :: held 1.014s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Created reservations ['ca4570be-da53-462e-baff-04c4deab7fd5', 'b7861999-59d8-42bc-a860-49139c6cbdec', 'e606d7c3-e08d-400c-91b5-fd6ffd96dc81', '5055d95f-7436-4b03-baf4-3b216e20f057'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:37 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642" returned: 0 in 0.430s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1371205033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51210bdf-ee49-4f87-8a45-d052056c46d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 51210bdf-ee49-4f87-8a45-d052056c46d4 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:37 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:37 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 1073741824
Apr 09 13:40:37 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae535f1-952d-42df-8efa-dbe2ab68ab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63cff543-f802-45e6-a9d7-23690479c642', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442e6a9c-84c9-4be3-865e-c8c7dd4b7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:37 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-63cff543-f802-45e6-a9d7-23690479c642 (63cff543-f802-45e6-a9d7-23690479c642): created successfully
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442e6a9c-84c9-4be3-865e-c8c7dd4b7e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:37 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (b3a53895-9f73-4eb4-ac54-a0850fdc5ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:38 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:38 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:38 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 1073741824" returned: 0 in 0.502s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:38 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c43cc756-6044-47b9-9902-cb4a01354a6d tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:38 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4
Apr 09 13:40:38 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:38 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:38 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Deleted volume successfully.
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b975d651-309f-4189-a39d-44ecc6571df2 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-2747421b-9975-4344-a0ee-1ae073a0d282-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "cinder-quobyte-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb71c4d-c7b5-4081-8dba-6495eab77185]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:38 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4" returned: 0 in 0.462s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.317s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642645266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b460bf-16de-4067-aadd-f2c6da595cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 25b460bf-16de-4067-aadd-f2c6da595cda {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:38 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:38 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda 1073741824
Apr 09 13:40:38 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:38 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd
Apr 09 13:40:38 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f454e544-62fb-43e5-b429-6cc1e0cf40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51210bdf-ee49-4f87-8a45-d052056c46d4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153d9e81-e9af-45d1-b83f-6128986f75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:38 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-51210bdf-ee49-4f87-8a45-d052056c46d4 (51210bdf-ee49-4f87-8a45-d052056c46d4): created successfully
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153d9e81-e9af-45d1-b83f-6128986f75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:38 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (f70f21ba-5e9b-4037-a260-820eedbea886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:39 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-ebc716c3-31df-48e2-ae41-02c34c05d962 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:39 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" returned: 0 in 0.510s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:39 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd
Apr 09 13:40:39 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:39 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda 1073741824" returned: 0 in 0.506s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:39 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda
Apr 09 13:40:39 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:39 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" returned: 0 in 0.422s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-quobyte-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd" released by "delete_volume" :: held 0.955s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Created reservations ['d64c7e47-e843-4743-a08f-e499938f6e3f', '3c2804f0-0f54-4968-9ef1-803de4214c1a', 'b6cf0c37-3c05-4154-83d2-5ce9b64f68c6', 'a04c3c9e-90b6-434d-bd60-4e235e8b11d4'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:39 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda" returned: 0 in 0.437s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.333s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603769881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce40836-7a45-47a3-a35c-fb63bafc75e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ade51752974a25b5f044434ac8f485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:33Z,use_quota=True,user_id='1694adca545444e7b965a9d32515f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Creating volume 1ce40836-7a45-47a3-a35c-fb63bafc75e4 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:39 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:39 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:39 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 1073741824
Apr 09 13:40:39 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:40 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:40 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1faea4c-bb56-452a-93cd-ead9b45c4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b460bf-16de-4067-aadd-f2c6da595cda', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450a89f9-78b3-4d45-9774-f910bb268aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:40 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-25b460bf-16de-4067-aadd-f2c6da595cda (25b460bf-16de-4067-aadd-f2c6da595cda): created successfully
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450a89f9-78b3-4d45-9774-f910bb268aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (2e55e2eb-5e2e-488d-a042-650fab7829ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:40 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-afc32f9a-0246-47fa-b641-60a0b9bd495d tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=125,cinder:INSERT=43,cinder:UPDATE=170,cinder:DELETE=14 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:40:40 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 1073741824" returned: 0 in 0.532s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:40 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.434s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:40 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Deleted volume successfully.
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-290ef742-7bbe-4c0c-bde6-10fba81495a7 tempest-CreateVolumesFromImageTest-420833347 None] Lock "cinder-e3e45533-6a04-42fa-9da3-9e6c1fbba5fd-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:40 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:40 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4
Apr 09 13:40:40 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:41 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4" returned: 0 in 0.443s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.955s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1524285846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c92023-7083-4b6e-b929-715ef0fe85b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37889b2bca4844279293ceff8df31c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:36Z,use_quota=True,user_id='e38921e985c64d2fa95aa09bc04fbafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Creating volume 49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:41 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5fc68e-5c6a-4182-89ff-17df966ded14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab9de31-7c74-4801-b6df-8c0c652dd1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:41 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 1073741824
Apr 09 13:40:41 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=149,cinder:SELECT=110,cinder:DELETE=15,cinder:INSERT=33 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:40:41 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Volume volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 (1ce40836-7a45-47a3-a35c-fb63bafc75e4): created successfully
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab9de31-7c74-4801-b6df-8c0c652dd1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Flow 'volume_create_manager' (1425a0eb-83fd-4963-849b-e1c0a3ddfd9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:41 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-17eb2ca6-9680-4e86-b45e-2800fd40ea9f tempest-CreateVolumesFromSnapshotTest-886311580 None] Created volume successfully.
Apr 09 13:40:41 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 1073741824" returned: 0 in 0.562s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:41 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:41 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:40:41 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-1ce40836-7a45-47a3-a35c-fb63bafc75e4-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-1ce40836-7a45-47a3-a35c-fb63bafc75e4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-1ce40836-7a45-47a3-a35c-fb63bafc75e4" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-1ce40836-7a45-47a3-a35c-fb63bafc75e4" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcfc636-33c1-464e-8da7-05b8818acbe0]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:42 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4
Apr 09 13:40:42 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:42 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.500s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.324s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53-b96246a8-6784-483e-bc90-63da69c7898a" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c826b4-f30e-4fd8-a4c9-38fb19a1b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c92023-7083-4b6e-b929-715ef0fe85b5', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c0d05-ddee-4f14-a604-1f666efa47ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Volume volume-49c92023-7083-4b6e-b929-715ef0fe85b5 (49c92023-7083-4b6e-b929-715ef0fe85b5): created successfully
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c0d05-ddee-4f14-a604-1f666efa47ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Flow 'volume_create_manager' (6e9e86c8-4368-4255-a8d7-fe1a933955fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53-b96246a8-6784-483e-bc90-63da69c7898a" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Creating volume b96246a8-6784-483e-bc90-63da69c7898a from snapshot c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:42 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-989d39cc-07c1-45fd-a46b-789fa70f597e tempest-SnapshotDependencyTests-1941593404 None] Created volume successfully.
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] snapshot: c990796a-119a-48e6-afca-5dd1b9c04c53, volume: b96246a8-6784-483e-bc90-63da69c7898a,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbe8fc-62d3-4a95-8beb-b748a6ae0009]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:42 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:42 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (5f013563-0aab-4182-8762-d7a11ca5efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a8104-4008-479e-a797-a6c93b05db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a8104-4008-479e-a797-a6c93b05db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892227365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6e3abf-a42c-4645-a42f-846a5cf8dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:43Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05080b22-6456-4170-b5f4-5bd81a77a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05080b22-6456-4170-b5f4-5bd81a77a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bc6a07-b570-4f8b-a270-b106a1a1940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bc6a07-b570-4f8b-a270-b106a1a1940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6e3abf-a42c-4645-a42f-846a5cf8dbe6', 'volume_name': 'volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0c3352-e3eb-40c7-8879-5ab72d404797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0c3352-e3eb-40c7-8879-5ab72d404797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:42 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e0d053-364f-4782-bed0-1372859f6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:42 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume 6a6e3abf-a42c-4645-a42f-846a5cf8dbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6', 'volume_size': 1}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:42 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4
Apr 09 13:40:42 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:42 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.534s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f4ff22-822e-4141-b962-1775b9ae974d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e676afe1-cd24-4c6c-9e15-861496fb0ee7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:42 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:42 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:42 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:43 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-1ce40836-7a45-47a3-a35c-fb63bafc75e4" returned: 0 in 0.420s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-1ce40836-7a45-47a3-a35c-fb63bafc75e4" released by "delete_volume" :: held 0.998s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['7d7cf044-9915-4a90-8bf5-0beb6256baa5', '174cc3fd-d73a-4abc-ab0d-6f49c0236e6f', '7bf98ed9-adb3-4adf-8cbe-c5a8f1245989', 'e5548532-cb9a-4c5c-87ad-a95af161fad3'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:43 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:43 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:43 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.569s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:43 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a
Apr 09 13:40:43 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:43 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.433s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:43 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:43 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-69050d32-24cb-4e6f-8628-eadea3c97990 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-1ce40836-7a45-47a3-a35c-fb63bafc75e4-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-25b460bf-16de-4067-aadd-f2c6da595cda-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-25b460bf-16de-4067-aadd-f2c6da595cda-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-25b460bf-16de-4067-aadd-f2c6da595cda" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-25b460bf-16de-4067-aadd-f2c6da595cda" acquired by "delete_volume" :: waited 0.022s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b07fd78-2af6-42b6-a713-5933cc1e99df]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:44 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:44 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda
Apr 09 13:40:44 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:45 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a" returned: 0 in 1.998s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd0f87f-97f5-4b1a-8967-462ea10da363]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:45 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:45 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:45 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda" returned: 0 in 1.103s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:45 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda
Apr 09 13:40:45 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:45 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-25b460bf-16de-4067-aadd-f2c6da595cda" returned: 0 in 0.424s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:45 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-25b460bf-16de-4067-aadd-f2c6da595cda" released by "delete_volume" :: held 1.583s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['840d5cc9-a77c-4aee-b7f1-2ed5c11d5405', '60c0793c-3302-453f-a334-a5d70d87b157', '9cad0ebf-6a54-4c24-ac22-f00740886eae', 'c915447b-8ade-48f1-b488-0e439b4504db'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:46 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.575s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:40:46 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Converted 1024.00 MB image at 512.06 MB/s
Apr 09 13:40:46 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a is being set with open permissions: ugo+rw
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:46 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a
Apr 09 13:40:46 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:46 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:46 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:46 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.404s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c66c00f4-a017-4c9d-82f4-a872619855ee tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-25b460bf-16de-4067-aadd-f2c6da595cda-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:46 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a" returned: 0 in 0.445s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" released by "_copy_volume_from_snapshot" :: held 4.178s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53-b96246a8-6784-483e-bc90-63da69c7898a" released by "_create_volume_from_snapshot" :: held 4.201s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.235s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.835s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892227365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6e3abf-a42c-4645-a42f-846a5cf8dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:43Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume 6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:46 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:46 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 1073741824
Apr 09 13:40:46 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-51210bdf-ee49-4f87-8a45-d052056c46d4-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a482db28-7eea-4891-8139-254b4307a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96246a8-6784-483e-bc90-63da69c7898a', 'volume_size': 1, 'snapshot_id': 'c990796a-119a-48e6-afca-5dd1b9c04c53'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aef259-e9fe-4542-987e-fd3b300e9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-51210bdf-ee49-4f87-8a45-d052056c46d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-51210bdf-ee49-4f87-8a45-d052056c46d4" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:46 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Volume volume-b96246a8-6784-483e-bc90-63da69c7898a (b96246a8-6784-483e-bc90-63da69c7898a): created successfully
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aef259-e9fe-4542-987e-fd3b300e9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (7e9a03cf-0e26-4408-95a4-0963907de564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-51210bdf-ee49-4f87-8a45-d052056c46d4" acquired by "delete_volume" :: waited 0.022s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:46 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-55209e82-ac3e-4bb7-8720-00fe8caa27ae tempest-VolumeDependencyTests-1008572340 None] Created volume successfully.
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a678700-62e2-432b-ace4-01290e3cf8e6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:46 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:46 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4
Apr 09 13:40:46 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 1073741824" returned: 0 in 0.510s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:47 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6
Apr 09 13:40:47 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:47 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4
Apr 09 13:40:47 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-c990796a-119a-48e6-afca-5dd1b9c04c53-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-c990796a-119a-48e6-afca-5dd1b9c04c53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Deleting offline snapshot c990796a-119a-48e6-afca-5dd1b9c04c53 of volume 18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] snapshot_file for this snap is: volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9330f79-e84d-44ea-8981-934d4805b4bc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:47 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.142s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:47 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:47 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e0d053-364f-4782-bed0-1372859f6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd94a1b-cd15-480a-8711-89878380d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Creating offline snapshot 0f18f282-4aec-4fa5-912c-1773e2dd9b36 of volume 49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:40:47 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:47 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 (6a6e3abf-a42c-4645-a42f-846a5cf8dbe6): created successfully
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd94a1b-cd15-480a-8711-89878380d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (5f013563-0aab-4182-8762-d7a11ca5efa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aa06e0-4f3e-4cf7-803c-6746062ae35f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-51210bdf-ee49-4f87-8a45-d052056c46d4" returned: 0 in 0.451s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:47 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1ea916b2-7d1d-4028-a7e5-aa942764d32c tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-51210bdf-ee49-4f87-8a45-d052056c46d4" released by "delete_volume" :: held 0.959s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['b5f45905-fae4-4d4a-97bc-8e41388a0fd8', 'bb5b5b65-74ce-43f6-8e54-a7d93a77968d', 'a953cdd2-b550-4f83-a1dc-01637749d80f', '4bb7e02b-cd14-4c19-9a7f-474febcdcb36'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:47 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:40:47 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:47 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:47 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:47 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.528s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f4ff22-822e-4141-b962-1775b9ae974d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254c1a0-28fa-4120-94c5-eb573f81eb98]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:47 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:48 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:48 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:48 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.545s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:48 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:48 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 1G
Apr 09 13:40:48 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (b0fe5642-912b-4968-91a1-8c19eb5c468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7f1503-8bbe-4dcd-a499-01a66389fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:48 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7f1503-8bbe-4dcd-a499-01a66389fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611533323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62444203-ac11-4065-a663-cbc0362fe307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:48Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe744af2-4fd2-441e-8c11-02bfd3ed7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe744af2-4fd2-441e-8c11-02bfd3ed7f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa7c15-a6a7-4f01-ad1b-cd5e2b828f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa7c15-a6a7-4f01-ad1b-cd5e2b828f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62444203-ac11-4065-a663-cbc0362fe307', 'volume_name': 'volume-62444203-ac11-4065-a663-cbc0362fe307', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea041094-997b-4b0c-9185-968b9f888ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea041094-997b-4b0c-9185-968b9f888ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea27ce2-1104-4a0d-801f-824516db2c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume 62444203-ac11-4065-a663-cbc0362fe307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62444203-ac11-4065-a663-cbc0362fe307', 'volume_size': 1}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-01c9010c-9a2c-4c8c-a966-0c30ac614185 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-51210bdf-ee49-4f87-8a45-d052056c46d4-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (94eaa075-8172-4c8f-adbf-4aaee7600dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3641a163-13f9-4e98-acd3-c4bb38630f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3641a163-13f9-4e98-acd3-c4bb38630f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459987360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58254238-7dbd-4c01-9563-7270b49e4827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:48Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2d0106-a34c-4b74-808b-a3ab89c1367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2d0106-a34c-4b74-808b-a3ab89c1367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7327149f-49f4-4a14-9ed9-be1867f1cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7327149f-49f4-4a14-9ed9-be1867f1cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58254238-7dbd-4c01-9563-7270b49e4827', 'volume_name': 'volume-58254238-7dbd-4c01-9563-7270b49e4827', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea859d43-3bd3-49db-bc57-f2d578d2a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea859d43-3bd3-49db-bc57-f2d578d2a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2645c3f-3481-47ac-b9d5-88dfbf7a5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume 58254238-7dbd-4c01-9563-7270b49e4827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58254238-7dbd-4c01-9563-7270b49e4827', 'volume_size': 1}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (1bc5c0ca-8c07-4513-9fad-d350914e0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dafa0b-6f7c-4f15-b05d-3850accd73d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dafa0b-6f7c-4f15-b05d-3850accd73d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129859298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501b2a43-e504-4f5c-863b-6beeefd65fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501b2a43-e504-4f5c-863b-6beeefd65fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21deef6c-2c99-4497-965a-3ccd2a8e7c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21deef6c-2c99-4497-965a-3ccd2a8e7c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e', 'volume_name': 'volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a74b89-54d6-4fe4-b4ce-a234f8844380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a74b89-54d6-4fe4-b4ce-a234f8844380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df550603-29f3-481b-84de-3fba3caeeb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e', 'volume_size': 1}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.673s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:48 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 1G" returned: 0 in 0.576s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c92023-7083-4b6e-b929-715ef0fe85b5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:48 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:48 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:48 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c92023-7083-4b6e-b929-715ef0fe85b5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:40:48 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-63cff543-f802-45e6-a9d7-23690479c642-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-63cff543-f802-45e6-a9d7-23690479c642-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-63cff543-f802-45e6-a9d7-23690479c642" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-63cff543-f802-45e6-a9d7-23690479c642" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7673e2-9ca3-47ba-8f08-7456c34a8893]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (8c991a21-1608-444a-963f-ae83382ff554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f779134-4294-4725-be6d-3b691eb55370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f779134-4294-4725-be6d-3b691eb55370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-388366259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6edf928-44ee-4cde-96fa-746e91897124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345b9f4-7c6d-4f99-a408-3d3684a5b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345b9f4-7c6d-4f99-a408-3d3684a5b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5638fca-8a5b-4bf2-9bbb-5623bec1fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5638fca-8a5b-4bf2-9bbb-5623bec1fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6edf928-44ee-4cde-96fa-746e91897124', 'volume_name': 'volume-f6edf928-44ee-4cde-96fa-746e91897124', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc457e8f-b6c9-4727-979c-69d41be0a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc457e8f-b6c9-4727-979c-69d41be0a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc81cd59-921d-44ea-b32d-b9f59cf5b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:48 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume f6edf928-44ee-4cde-96fa-746e91897124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6edf928-44ee-4cde-96fa-746e91897124', 'volume_size': 1}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:48 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (018115a9-cf2c-4885-ae6a-a55b9d21c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2eb204-188f-4dc1-8908-4f93d70d2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2eb204-188f-4dc1-8908-4f93d70d2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572491318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91dea66-768c-4298-80cc-78ed577ed7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d50bdb2-9c75-45db-9d76-fc8fda3d22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d50bdb2-9c75-45db-9d76-fc8fda3d22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77909a7f-d7cd-490f-8322-2315359c35d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77909a7f-d7cd-490f-8322-2315359c35d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91dea66-768c-4298-80cc-78ed577ed7f7', 'volume_name': 'volume-e91dea66-768c-4298-80cc-78ed577ed7f7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35c3ba-bff2-40d2-971a-e61c1c4e2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35c3ba-bff2-40d2-971a-e61c1c4e2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eacd8c8-ce15-4647-b761-6e320cd9cfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:49 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume e91dea66-768c-4298-80cc-78ed577ed7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91dea66-768c-4298-80cc-78ed577ed7f7', 'volume_size': 1}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:49 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c92023-7083-4b6e-b929-715ef0fe85b5 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.524s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 is being set with open permissions: ugo+rw
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:49 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.578s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:49 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:40:49 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:49 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53
Apr 09 13:40:49 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:49 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642" returned: 0 in 0.547s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:49 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642
Apr 09 13:40:49 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:49 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d.c990796a-119a-48e6-afca-5dd1b9c04c53" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-c990796a-119a-48e6-afca-5dd1b9c04c53" released by "_delete_snapshot" :: held 2.257s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" released by "delete_snapshot" :: held 2.268s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:49 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info
Apr 09 13:40:49 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Created reservations ['c3129eea-ce24-40f9-8ce7-d733b0b688bc', '9426edb4-2f7e-4739-97b1-3519ea5e7a3c', '194f2964-b922-41d1-819f-e26eacf52bd3', '34b05213-996b-4088-b46a-9ebad17bd916'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:49 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Delete snapshot completed successfully.
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e87b3dbf-9f6a-468c-8a08-46dbdf768d43 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-c990796a-119a-48e6-afca-5dd1b9c04c53-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:49 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-63cff543-f802-45e6-a9d7-23690479c642" returned: 0 in 0.440s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-63cff543-f802-45e6-a9d7-23690479c642" released by "delete_volume" :: held 1.026s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['ebb8a19b-fc0b-4961-839e-1d9d6747bd20', '150ba971-32db-4d29-ac77-c5802063ad20', 'ccabe9e7-1c9f-4f13-b613-ba4eb0762e5e', '8fb605d2-ff86-4fd1-b9a8-a64e8f7302ab'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:49 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:49 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:49 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:50 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:50 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info is being set with open permissions: ugo+rw
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:50 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info
Apr 09 13:40:50 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:50 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.407s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-db8c6a0b-95e9-4fb6-bee6-7cbf3c29d265 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-63cff543-f802-45e6-a9d7-23690479c642-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-18f4ff22-822e-4141-b962-1775b9ae974d-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-18f4ff22-822e-4141-b962-1775b9ae974d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:50 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.info" returned: 0 in 0.418s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.055s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611533323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62444203-ac11-4065-a663-cbc0362fe307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:48Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume 62444203-ac11-4065-a663-cbc0362fe307 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:50 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:50 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 1073741824
Apr 09 13:40:50 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:50 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-18fd116f-efd5-47d6-a0d9-4f7cda507c09 tempest-SnapshotDependencyTests-1941593404 None] Create snapshot completed successfully
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ad99f-331b-4e54-ad7e-c2233c8a3f62]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:50 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:50 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-636b6c0f-1f8b-4323-9c81-56e4577c390e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-636b6c0f-1f8b-4323-9c81-56e4577c390e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-636b6c0f-1f8b-4323-9c81-56e4577c390e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-636b6c0f-1f8b-4323-9c81-56e4577c390e" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aafdfc-65aa-47c8-87bf-2d6d546d19a4]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:50 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 1073741824" returned: 0 in 0.509s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:51 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e
Apr 09 13:40:51 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307
Apr 09 13:40:51 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.511s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d
Apr 09 13:40:51 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307" returned: 0 in 0.407s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.132s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459987360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58254238-7dbd-4c01-9563-7270b49e4827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:48Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume 58254238-7dbd-4c01-9563-7270b49e4827 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:51 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e
Apr 09 13:40:51 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:51 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea27ce2-1104-4a0d-801f-824516db2c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62444203-ac11-4065-a663-cbc0362fe307', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:51 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 1073741824
Apr 09 13:40:51 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e523505-29cc-4d81-84a7-ea76c3d4b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:51 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-62444203-ac11-4065-a663-cbc0362fe307 (62444203-ac11-4065-a663-cbc0362fe307): created successfully
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e523505-29cc-4d81-84a7-ea76c3d4b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (b0fe5642-912b-4968-91a1-8c19eb5c468d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:51 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-18f4ff22-822e-4141-b962-1775b9ae974d" returned: 0 in 0.454s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:51 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-42584de8-e596-4ac2-ad70-3fb488111554 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-18f4ff22-822e-4141-b962-1775b9ae974d" released by "delete_volume" :: held 1.003s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Created reservations ['1580abc3-e53d-4300-85cd-4466f43e8a74', 'eccbfc2a-4129-455a-9021-62627e7074f0', 'e181ba85-b94e-4fd1-9ebd-60d212d9a42f', '4b0dd041-c36b-454f-b30b-5d119110e593'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:51 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:51 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:51 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Flow 'volume_create_manager' (d59b35ca-3583-42ef-a8bf-3db4f1504f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6153867b-d7cf-46db-88e1-a722c48fb360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6153867b-d7cf-46db-88e1-a722c48fb360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fbff2a-0897-4e88-afb8-325d4976510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37889b2bca4844279293ceff8df31c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f18f282-4aec-4fa5-912c-1773e2dd9b36,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:52Z,use_quota=True,user_id='e38921e985c64d2fa95aa09bc04fbafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b72136d-cb72-4490-93b3-f1f06e2149d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b72136d-cb72-4490-93b3-f1f06e2149d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763dcb38-394e-45c0-bacb-b429eba5cd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763dcb38-394e-45c0-bacb-b429eba5cd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31fbff2a-0897-4e88-afb8-325d4976510f', 'volume_name': 'volume-31fbff2a-0897-4e88-afb8-325d4976510f', 'volume_size': 1, 'snapshot_id': '0f18f282-4aec-4fa5-912c-1773e2dd9b36'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014c44f-c4c3-4e35-889a-810bb8006020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014c44f-c4c3-4e35-889a-810bb8006020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5c6b1-f3d7-4ad2-b032-792e567d5ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Volume 31fbff2a-0897-4e88-afb8-325d4976510f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31fbff2a-0897-4e88-afb8-325d4976510f', 'volume_size': 1, 'snapshot_id': '0f18f282-4aec-4fa5-912c-1773e2dd9b36'}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-636b6c0f-1f8b-4323-9c81-56e4577c390e" returned: 0 in 0.577s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-636b6c0f-1f8b-4323-9c81-56e4577c390e" released by "delete_volume" :: held 1.122s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['609ef437-04b9-413a-a40c-a2b58e7a066d', 'ed91ed3c-f235-497d-b08e-e44a50613119', '7e87f726-3bef-4b36-aed1-4fe3d1b7f222', '9d240ead-4d01-4ad6-a4d1-cb95d403122d'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:52 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 1073741824" returned: 0 in 0.629s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:52 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.492s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Deleted volume successfully.
Apr 09 13:40:52 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:52 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8257c347-ee33-42a3-a8b1-58763d2b9a57 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-18f4ff22-822e-4141-b962-1775b9ae974d-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:52 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827
Apr 09 13:40:52 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:52 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.421s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3f2900fb-81d5-4acc-98b0-2c727c2a8adb tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-636b6c0f-1f8b-4323-9c81-56e4577c390e-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:52 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827" returned: 0 in 0.410s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.983s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129859298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2645c3f-3481-47ac-b9d5-88dfbf7a5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58254238-7dbd-4c01-9563-7270b49e4827', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07925774-94ef-484d-8e63-90697f1ae0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e 1073741824
Apr 09 13:40:52 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-58254238-7dbd-4c01-9563-7270b49e4827 (58254238-7dbd-4c01-9563-7270b49e4827): created successfully
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07925774-94ef-484d-8e63-90697f1ae0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (94eaa075-8172-4c8f-adbf-4aaee7600dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:52 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-75954b5d-ba94-4a4d-a9a1-303674d5bc23 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (750b9110-b04b-4afb-8da2-eb5b83b654ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b15825-1dfb-4d5f-a0e2-fb692e1fe034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b15825-1dfb-4d5f-a0e2-fb692e1fe034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1038122945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f208a08c-4c87-49ff-a0d7-84624980d806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:53Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29f8ed2-19b0-4d95-9683-e520aacd0438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29f8ed2-19b0-4d95-9683-e520aacd0438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286eb961-25fa-45de-860f-c773928439f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286eb961-25fa-45de-860f-c773928439f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f208a08c-4c87-49ff-a0d7-84624980d806', 'volume_name': 'volume-f208a08c-4c87-49ff-a0d7-84624980d806', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:52 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b6c08d-5e14-4fdd-8a4e-16a4fe159963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b6c08d-5e14-4fdd-8a4e-16a4fe159963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e381eb8-e6ba-4832-bced-99c21d597c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Volume f208a08c-4c87-49ff-a0d7-84624980d806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f208a08c-4c87-49ff-a0d7-84624980d806', 'volume_size': 1}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-e94adef6-2c92-4fa8-97ad-3235bc7ba719-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-e94adef6-2c92-4fa8-97ad-3235bc7ba719-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-e94adef6-2c92-4fa8-97ad-3235bc7ba719" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-e94adef6-2c92-4fa8-97ad-3235bc7ba719" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleting offline snapshot e94adef6-2c92-4fa8-97ad-3235bc7ba719 of volume 36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] snapshot_file for this snap is: volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce551803-bc25-41bf-91c1-285ccd97be62]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:53 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e 1073741824" returned: 0 in 0.533s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:53 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719
Apr 09 13:40:53 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:53 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e
Apr 09 13:40:53 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:53 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:53 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" returned: 0 in 0.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.659s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-388366259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6edf928-44ee-4cde-96fa-746e91897124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume f6edf928-44ee-4cde-96fa-746e91897124 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:53 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:53 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 1073741824
Apr 09 13:40:53 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df550603-29f3-481b-84de-3fba3caeeb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13db8b-e83a-4282-9e49-1ec4e3579355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[85962a40-ca76-4a7b-a589-04bcb52634ff]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:53 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e (a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e): created successfully
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13db8b-e83a-4282-9e49-1ec4e3579355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:53 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (1bc5c0ca-8c07-4513-9fad-d350914e0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:53 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-4c98609e-1b30-4d74-8967-b2262452fb90 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:53 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a
Apr 09 13:40:53 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:54 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 1073741824" returned: 0 in 0.531s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:54 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124
Apr 09 13:40:54 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:54 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" returned: 0 in 0.538s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:54 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719
Apr 09 13:40:54 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:54 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124" returned: 0 in 0.431s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.564s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572491318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91dea66-768c-4298-80cc-78ed577ed7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac05d5085a345398ba66779134fb05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:49Z,use_quota=True,user_id='b3503340be32455082361fbfe8c4b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Creating volume e91dea66-768c-4298-80cc-78ed577ed7f7 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:54 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc81cd59-921d-44ea-b32d-b9f59cf5b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6edf928-44ee-4cde-96fa-746e91897124', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cbb794-74ee-46e2-875a-6bf5df17df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:54 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 1073741824
Apr 09 13:40:54 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:54 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-f6edf928-44ee-4cde-96fa-746e91897124 (f6edf928-44ee-4cde-96fa-746e91897124): created successfully
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cbb794-74ee-46e2-875a-6bf5df17df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (8c991a21-1608-444a-963f-ae83382ff554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:54 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2190de7d-617a-43dd-9c6e-5d1fb6d904f0 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:54 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719" returned: 0 in 0.469s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:54 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:54 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719
Apr 09 13:40:54 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:55 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a.e94adef6-2c92-4fa8-97ad-3235bc7ba719" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:55 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-e94adef6-2c92-4fa8-97ad-3235bc7ba719" released by "_delete_snapshot" :: held 1.997s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 1073741824" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" released by "delete_snapshot" :: held 2.008s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:55 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7
Apr 09 13:40:55 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['517ebe18-6b4a-40c9-a495-004bfff1ccc4', 'f46eda35-89de-4790-8291-9339377fe27b', '38049881-ee18-4fd8-9810-7948904477a1', '0778bca5-abce-46a6-a6c7-cf25266cec87'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Delete snapshot completed successfully.
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-8a722adf-50de-4766-85a6-9b7f6cdc9e3a tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-e94adef6-2c92-4fa8-97ad-3235bc7ba719-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:55 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7" returned: 0 in 0.426s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.511s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36-31fbff2a-0897-4e88-afb8-325d4976510f" by "_create_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eacd8c8-ce15-4647-b761-6e320cd9cfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91dea66-768c-4298-80cc-78ed577ed7f7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f19c43-6fed-40e3-886d-2273594b46c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:40:55 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Volume volume-e91dea66-768c-4298-80cc-78ed577ed7f7 (e91dea66-768c-4298-80cc-78ed577ed7f7): created successfully
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f19c43-6fed-40e3-886d-2273594b46c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Flow 'volume_create_manager' (018115a9-cf2c-4885-ae6a-a55b9d21c9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36-31fbff2a-0897-4e88-afb8-325d4976510f" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Creating volume 31fbff2a-0897-4e88-afb8-325d4976510f from snapshot 0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:55 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-45b8fb59-df5b-499e-9e6b-c0fca0d9ed85 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created volume successfully.
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] snapshot: 0f18f282-4aec-4fa5-912c-1773e2dd9b36, volume: 31fbff2a-0897-4e88-afb8-325d4976510f,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dbfc68-ee9f-4936-9a16-cd33feeba855]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:55 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:55 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:40:55 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:56 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49c92023-7083-4b6e-b929-715ef0fe85b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a879360-180f-4ef5-987e-cedbe1b38352]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:56 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:40:56 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611d37a-926a-49e5-a596-6b7d12d73583]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:56 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a
Apr 09 13:40:56 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-e91dea66-768c-4298-80cc-78ed577ed7f7-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-e91dea66-768c-4298-80cc-78ed577ed7f7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-e91dea66-768c-4298-80cc-78ed577ed7f7" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-e91dea66-768c-4298-80cc-78ed577ed7f7" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff11d7d8-b974-4e0e-9848-8f9b72da813a]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:56 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7
Apr 09 13:40:56 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:56 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.516s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:56 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f
Apr 09 13:40:56 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:56 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" returned: 0 in 0.515s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:56 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:56 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a
Apr 09 13:40:56 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:57 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7" returned: 0 in 0.504s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:57 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7
Apr 09 13:40:57 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:57 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" returned: 0 in 0.855s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-quobyte-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a" released by "delete_volume" :: held 1.422s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Created reservations ['47075b32-e4e1-4df7-b174-77404302b8db', '5e9a39ef-7548-4236-8d7c-c266ab2d9401', '2c6a102f-ea2c-48c2-ad6b-1383d669aa04', '567d87d3-a030-4e89-9763-6792c513e72f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:57 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-e91dea66-768c-4298-80cc-78ed577ed7f7" returned: 0 in 0.846s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:57 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-e91dea66-768c-4298-80cc-78ed577ed7f7" released by "delete_volume" :: held 1.396s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:58 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:58 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['fd191bc5-c56f-4677-adf6-6a673a590b32', '6219bafd-a314-4ca9-b04b-5016cf363306', '1cc2f2ce-286b-4ddf-8315-068ff7453a62', 'a81101ac-9af2-4cc6-932a-17432d5ad7f8'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:58 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:40:58 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:58 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.619s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:58 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Deleted volume successfully.
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5b4d84d2-4c5a-467e-8b39-cb68b502d8a3 tempest-CreateVolumesFromSnapshotTest-886311580 None] Lock "cinder-36f3a5fd-3b61-4a83-bb3e-a45bfd3eea6a-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-f6edf928-44ee-4cde-96fa-746e91897124-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:58 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-f6edf928-44ee-4cde-96fa-746e91897124-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-f6edf928-44ee-4cde-96fa-746e91897124" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-f6edf928-44ee-4cde-96fa-746e91897124" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9562446-35b5-466c-a10e-112054f0aa35]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:59 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f" returned: 0 in 2.486s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:59 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124
Apr 09 13:40:59 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[2468d749-92f9-45e9-8b41-33c7c063ca05]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:59 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.932s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:40:59 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-48020cca-138d-4714-9e6f-4d022dd4d8ab tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-e91dea66-768c-4298-80cc-78ed577ed7f7-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:40:59 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:40:59 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:59 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124" returned: 0 in 0.604s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:59 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124
Apr 09 13:40:59 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:40:59 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.697s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:40:59 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Converted 1024.00 MB image at 411.69 MB/s
Apr 09 13:40:59 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f is being set with open permissions: ugo+rw
Apr 09 13:40:59 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:40:59 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f
Apr 09 13:40:59 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:00 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f6edf928-44ee-4cde-96fa-746e91897124" returned: 0 in 0.494s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-f6edf928-44ee-4cde-96fa-746e91897124" released by "delete_volume" :: held 1.137s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['575a741b-19b5-4b59-a841-6430b1d4dd1e', '4e3cc3ea-480e-40cd-9578-e57946f3a969', '701253cc-acf9-41b2-abc9-4c608e1c3dd8', 'cd5704b3-2b02-4a69-9f92-59c2cfa860f2'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:00 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:00 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:00 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f" returned: 0 in 0.497s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" released by "_copy_volume_from_snapshot" :: held 4.744s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36-31fbff2a-0897-4e88-afb8-325d4976510f" released by "_create_volume_from_snapshot" :: held 4.781s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.812s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.401s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1038122945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f208a08c-4c87-49ff-a0d7-84624980d806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:40:53Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Creating volume f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:41:00 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:00 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 1073741824
Apr 09 13:41:00 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5c6b1-f3d7-4ad2-b032-792e567d5ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31fbff2a-0897-4e88-afb8-325d4976510f', 'volume_size': 1, 'snapshot_id': '0f18f282-4aec-4fa5-912c-1773e2dd9b36'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6677f0-8574-415d-b742-108e789439d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Volume volume-31fbff2a-0897-4e88-afb8-325d4976510f (31fbff2a-0897-4e88-afb8-325d4976510f): created successfully
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6677f0-8574-415d-b742-108e789439d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Flow 'volume_create_manager' (d59b35ca-3583-42ef-a8bf-3db4f1504f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-7c6e6fc2-88d4-4e41-adc6-9c6baa793cb0 tempest-SnapshotDependencyTests-1941593404 None] Created volume successfully.
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Flow 'volume_create_manager' (f4c987cf-9ade-4cd9-9ae4-fba46bc12b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2ed797-3895-4588-9896-8c051e806abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2ed797-3895-4588-9896-8c051e806abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d204a7e-2bc4-4424-8b8f-cd1371bda4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaefaac6dec44098db96c5c1b13be90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:41:01Z,use_quota=True,user_id='91a1e94dd4a34316b7d7f1283d8dca99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40f4754-49cf-4ade-ac40-aa2968ca7ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40f4754-49cf-4ade-ac40-aa2968ca7ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c88887-19cc-4e15-8c7b-605fc80029a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c88887-19cc-4e15-8c7b-605fc80029a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d204a7e-2bc4-4424-8b8f-cd1371bda4d7', 'volume_name': 'volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49214d2-de85-4625-9323-9b8f734d9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49214d2-de85-4625-9323-9b8f734d9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e41c7-52a0-4817-a84a-7d33be452bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:00 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Volume 9d204a7e-2bc4-4424-8b8f-cd1371bda4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7', 'volume_size': 1}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.581s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:00 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c368d020-2357-4bb6-baf4-24190360996e tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-f6edf928-44ee-4cde-96fa-746e91897124-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:00 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 1073741824" returned: 0 in 0.519s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:00 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:00 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:00 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270d71e-ca92-49d3-890e-27b3c73fd2ca]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:01 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e
Apr 09 13:41:01 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:01 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.441s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d204a7e-2bc4-4424-8b8f-cd1371bda4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaefaac6dec44098db96c5c1b13be90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:41:01Z,use_quota=True,user_id='91a1e94dd4a34316b7d7f1283d8dca99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Creating volume 9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:41:01 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e381eb8-e6ba-4832-bced-99c21d597c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f208a08c-4c87-49ff-a0d7-84624980d806', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ccfc4d-d54b-4c70-94aa-7a0e073862ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:01 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 1073741824
Apr 09 13:41:01 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:01 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Volume volume-f208a08c-4c87-49ff-a0d7-84624980d806 (f208a08c-4c87-49ff-a0d7-84624980d806): created successfully
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ccfc4d-d54b-4c70-94aa-7a0e073862ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (750b9110-b04b-4afb-8da2-eb5b83b654ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:01 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-f84f6f28-403f-4e84-a3ed-535c04cff8a6 tempest-VolumeDependencyTests-1008572340 None] Created volume successfully.
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-0f18f282-4aec-4fa5-912c-1773e2dd9b36-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-0f18f282-4aec-4fa5-912c-1773e2dd9b36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Deleting offline snapshot 0f18f282-4aec-4fa5-912c-1773e2dd9b36 of volume 49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] snapshot_file for this snap is: volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8277c31-74e2-4d17-bd77-291d4213a113]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:01 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:41:01 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:01 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" returned: 0 in 0.558s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:01 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e
Apr 09 13:41:01 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:01 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 1073741824" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:01 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:01 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7
Apr 09 13:41:01 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:02 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.499s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49c92023-7083-4b6e-b929-715ef0fe85b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb98a83d-ae79-4f6a-9a66-56e4d27582a7]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:02 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:41:02 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:02 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" returned: 0 in 0.415s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e" released by "delete_volume" :: held 1.008s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['dc409fd0-d2d7-4de3-809e-25a49afde34f', 'b7a58f04-3764-43de-b6e3-e8a0b37bfc93', '14ae91f5-b3bb-4d36-8c98-50eaa91fcd4f', '79780dc7-a068-4797-ae97-a80378549ff0'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:02 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" returned: 0 in 0.420s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:02 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:02 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e41c7-52a0-4817-a84a-7d33be452bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6b1fd-3a37-4f30-9bc7-4d21cc95d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Volume volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 (9d204a7e-2bc4-4424-8b8f-cd1371bda4d7): created successfully
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6b1fd-3a37-4f30-9bc7-4d21cc95d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Flow 'volume_create_manager' (f4c987cf-9ade-4cd9-9ae4-fba46bc12b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b808988a-7c15-4987-911c-f20f61039a71 tempest-CinderUnicodeTest-1040560343 None] Created volume successfully.
Apr 09 13:41:02 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.525s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:02 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:41:02 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (ec045129-1eb4-48bb-bf1d-4312c00354a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6221c304-2157-4970-982e-c2c9c54a0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:02 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6221c304-2157-4970-982e-c2c9c54a0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1693458056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074b557f-6399-42f5-8e16-65ef9d049359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96bbd387879468197cb46e2aaa6c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f208a08c-4c87-49ff-a0d7-84624980d806,status='creating',terminated_at=None,updated_at=2026-04-09T11:41:03Z,use_quota=True,user_id='5a8ed76c2214459394787acd5f45f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15678655-1b26-47f7-bb80-0cdbe67dc705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15678655-1b26-47f7-bb80-0cdbe67dc705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d821c7-1e09-43c7-af9a-664e50885747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d821c7-1e09-43c7-af9a-664e50885747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '074b557f-6399-42f5-8e16-65ef9d049359', 'volume_name': 'volume-074b557f-6399-42f5-8e16-65ef9d049359', 'volume_size': 1, 'source_volid': 'f208a08c-4c87-49ff-a0d7-84624980d806', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ab9da0-7128-4725-a2d6-453f49e875f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ab9da0-7128-4725-a2d6-453f49e875f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5115843f-0cc8-4721-b761-ee9dc9a6c2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:02 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Volume 074b557f-6399-42f5-8e16-65ef9d049359: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-074b557f-6399-42f5-8e16-65ef9d049359', 'volume_size': 1, 'source_volid': 'f208a08c-4c87-49ff-a0d7-84624980d806', 'source_volstatus': 'available'}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-0f792c7f-f58f-4a00-a324-e5729baa15a7 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-a75a8d1f-d0e1-4399-89a2-8ef61cfa2c8e-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:02 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Cloning volume f208a08c-4c87-49ff-a0d7-84624980d806 to volume 074b557f-6399-42f5-8e16-65ef9d049359
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Creating offline snapshot 8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c of volume f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae813b6e-5c33-47ce-99e2-1820843443ef]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:02 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:02 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:02 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:03 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.502s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:03 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36
Apr 09 13:41:03 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82360) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Flow 'volume_create_manager' (65d46214-16a6-4455-b5f6-7ee1cf6b82f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f620500-6f4f-4a92-b28d-8a08d7e17ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f620500-6f4f-4a92-b28d-8a08d7e17ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:41:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086960441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715189bf-96a0-47ec-aeef-cb603779e4ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaefaac6dec44098db96c5c1b13be90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:41:03Z,use_quota=True,user_id='91a1e94dd4a34316b7d7f1283d8dca99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b02e54-d641-4a54-b068-180532c96926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b02e54-d641-4a54-b068-180532c96926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7583cc3-fd40-4c5e-93de-68ceca248aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7583cc3-fd40-4c5e-93de-68ceca248aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715189bf-96a0-47ec-aeef-cb603779e4ab', 'volume_name': 'volume-715189bf-96a0-47ec-aeef-cb603779e4ab', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066fdfd0-3bea-40ff-abeb-db90838805c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066fdfd0-3bea-40ff-abeb-db90838805c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42323250-1e9a-4ad9-8f60-86afc578fcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:03 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Volume 715189bf-96a0-47ec-aeef-cb603779e4ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715189bf-96a0-47ec-aeef-cb603779e4ab', 'volume_size': 1}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-58254238-7dbd-4c01-9563-7270b49e4827-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-58254238-7dbd-4c01-9563-7270b49e4827-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-58254238-7dbd-4c01-9563-7270b49e4827" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:03 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-58254238-7dbd-4c01-9563-7270b49e4827" acquired by "delete_volume" :: waited 0.006s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.566s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c08fe63-09a4-4914-92af-4a5d03c7be71]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:03 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c 1G
Apr 09 13:41:03 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:03 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827
Apr 09 13:41:03 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:03 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5.0f18f282-4aec-4fa5-912c-1773e2dd9b36" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-0f18f282-4aec-4fa5-912c-1773e2dd9b36" released by "_delete_snapshot" :: held 2.055s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" released by "delete_snapshot" :: held 2.066s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Created reservations ['83a6a626-3fbe-4886-a153-a8cd21bd6a58', 'aca5d4f0-dd83-49cb-b2e7-acc9b39f072c', '73730a67-e0c4-43a2-bbb3-5953db35395d', 'f66ebec7-4161-427f-a054-daefe81569fd'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:03 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Delete snapshot completed successfully.
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-157e0cc8-c76c-4e9a-941e-c95c0c70c0f6 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-0f18f282-4aec-4fa5-912c-1773e2dd9b36-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:03 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c 1G" returned: 0 in 0.497s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f208a08c-4c87-49ff-a0d7-84624980d806 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:03 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827" returned: 0 in 0.496s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:03 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f208a08c-4c87-49ff-a0d7-84624980d806 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:04 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827
Apr 09 13:41:04 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-58254238-7dbd-4c01-9563-7270b49e4827" returned: 0 in 0.410s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-58254238-7dbd-4c01-9563-7270b49e4827" released by "delete_volume" :: held 0.936s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:04 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f208a08c-4c87-49ff-a0d7-84624980d806 -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:04 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c is being set with open permissions: ugo+rw
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:04 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['5e2c74b4-58b5-49f8-83cb-138d1e121d32', '048360a2-8591-408e-bb8d-e64efdd01f0b', '068c800a-23b2-4768-bf37-196a06e8c60f', 'aa09bf99-b2f6-45a4-9d98-b8e9d537f85e'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:04 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-62444203-ac11-4065-a663-cbc0362fe307-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-62444203-ac11-4065-a663-cbc0362fe307-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-62444203-ac11-4065-a663-cbc0362fe307" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-62444203-ac11-4065-a663-cbc0362fe307" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[265f4a3b-34a2-4c18-83b0-a65889f0a697]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-49c92023-7083-4b6e-b929-715ef0fe85b5-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-49c92023-7083-4b6e-b929-715ef0fe85b5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37a7e4-aaf3-4d8f-88d0-c2d079512a6c]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307
Apr 09 13:41:04 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:41:04 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:04 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.469s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:04 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:04 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info
Apr 09 13:41:04 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.555s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:05 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-3e42fef7-144b-4b4b-a245-26ee18772e6b tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-58254238-7dbd-4c01-9563-7270b49e4827-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_service.periodic_task [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82360) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307" returned: 0 in 0.553s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:05 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307
Apr 09 13:41:05 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.576s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5
Apr 09 13:41:05 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info is being set with open permissions: ugo+rw
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info
Apr 09 13:41:05 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.413s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-7512123c-888f-4259-9e9f-52bb6cf4e036 None None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:05 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-62444203-ac11-4065-a663-cbc0362fe307" returned: 0 in 0.457s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-62444203-ac11-4065-a663-cbc0362fe307" released by "delete_volume" :: held 1.046s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['2b4d7dfa-401f-4a85-968a-7107d71483f5', 'adbcfbb9-7c9c-45bf-8685-adb0cd10d4f5', 'bf86555b-62da-493b-87e0-c5010f942000', 'f9dbf8af-3220-4f9f-af61-90e5d366e727'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:05 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-49c92023-7083-4b6e-b929-715ef0fe85b5" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-49c92023-7083-4b6e-b929-715ef0fe85b5" released by "delete_volume" :: held 1.082s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:05 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.info" returned: 0 in 0.450s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" by "_copy_volume_from_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] snapshot: 8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c, volume: 074b557f-6399-42f5-8e16-65ef9d049359,  {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[84403300-1b08-4ed8-9e6c-186ef7e18c61]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Created reservations ['b5a08e10-4bf8-4b55-a051-efa9c6c24b96', 'e787197d-c6b4-4396-8753-bd1213c3a908', 'b80a0a46-c193-4a65-aa7f-ef51f4791c19', '7204b628-3536-431a-a3be-0c4db62a3523'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:05 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:05 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:05 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:05 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:05 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:06 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.444s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-2e8866b5-be41-4862-ba6a-de7a1f9b5a0a tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-62444203-ac11-4065-a663-cbc0362fe307-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:06 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.505s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f208a08c-4c87-49ff-a0d7-84624980d806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:41:06 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Creating direct copy from snapshot {{(pid=82360) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.438s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:06 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Deleted volume successfully.
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[0517ad1b-d3d5-48c7-9a43-4debc425ded1]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-a8c7a8e4-8056-426d-9bb9-4f9d8aa1b6e3 tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-49c92023-7083-4b6e-b929-715ef0fe85b5-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:06 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:06 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "cinder-quobyte-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" acquired by "delete_volume" :: waited 0.011s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2cdfe4-02ce-4e69-99a0-e0629678460e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-31fbff2a-0897-4e88-afb8-325d4976510f-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-31fbff2a-0897-4e88-afb8-325d4976510f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:06 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.489s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.utils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Path /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 not found in is_blk_device check {{(pid=82360) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:06 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6
Apr 09 13:41:06 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:06 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359
Apr 09 13:41:06 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b99931-7a27-4a3e-98da-3707592b78f3]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:06 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:07 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f
Apr 09 13:41:07 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:07 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" returned: 0 in 0.535s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:07 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6
Apr 09 13:41:07 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:07 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f" returned: 0 in 0.851s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:07 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:07 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f
Apr 09 13:41:07 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:08 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" returned: 0 in 1.449s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-quobyte-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6" released by "delete_volume" :: held 2.017s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:08 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:08 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-31fbff2a-0897-4e88-afb8-325d4976510f" returned: 0 in 1.144s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:08 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-quobyte-31fbff2a-0897-4e88-afb8-325d4976510f" released by "delete_volume" :: held 2.023s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:08 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Created reservations ['a9df88a6-2158-46c4-af7f-a602e9434081', '10e4e589-3aa4-4ac0-80a9-2cb740819e87', '6d9aeb4e-8660-4fd0-9f17-a3ac24383e2a', '2d7f060f-5960-4f5b-8a5d-420e9093cba9'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:09 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359" returned: 0 in 2.156s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Created reservations ['246546a3-19f0-4e58-8a79-f15dcbce6208', '1e43d71b-26b0-4395-8440-d53d59218d8d', '4dc14528-b62b-472f-9210-a132b2ae5a30', 'b02014cf-a18f-45c1-b707-c522ede20257'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:09 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:09 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[80117d39-f8be-4506-949e-e6cf7df82409]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:09 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:09 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:09 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:09 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:09 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.471s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Deleted volume successfully.
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-5ef5d03d-6b02-4fdd-b3c1-14432691bcb3 tempest-CreateVolumesFromSourceVolumeTest-1127245939 None] Lock "cinder-6a6e3abf-a42c-4645-a42f-846a5cf8dbe6-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:09 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.508s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:09 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Deleted volume successfully.
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-630f9903-dc08-4b10-9ee5-5707483cef2e tempest-SnapshotDependencyTests-1941593404 None] Lock "cinder-31fbff2a-0897-4e88-afb8-325d4976510f-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:09 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.931s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG cinder.image.image_utils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Image conversion details: src /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 {{(pid=82360) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 13:41:09 devstack cinder-volume[82360]: INFO cinder.image.image_utils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Converted 1024.00 MB image at 474.61 MB/s
Apr 09 13:41:09 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 is being set with open permissions: ugo+rw
Apr 09 13:41:09 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:10 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359
Apr 09 13:41:10 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:10 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359" returned: 0 in 0.514s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" released by "_copy_volume_from_snapshot" :: held 4.651s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Deleting offline snapshot 8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c of volume f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] snapshot_file for this snap is: volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed44274-1a71-4adf-95af-912ed13a5da6]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:10 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:10 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:10 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:11 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.519s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f208a08c-4c87-49ff-a0d7-84624980d806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[327830ba-902b-4ec4-8559-3f7d97c65a75]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:11 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:11 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:11 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.482s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:11 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:11 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:11 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:12 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.491s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:12 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c
Apr 09 13:41:12 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:12 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806.8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" returned: 0 in 0.427s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-8d2afa52-a6e3-4b3e-b8f4-b4b298a64e7c" released by "_delete_snapshot" :: held 1.965s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.642s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.249s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f31bea5c5b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T11:41:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086960441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715189bf-96a0-47ec-aeef-cb603779e4ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaefaac6dec44098db96c5c1b13be90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:41:03Z,use_quota=True,user_id='91a1e94dd4a34316b7d7f1283d8dca99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(644e81a1-0052-4a85-9716-0f4caaa4dbf7),volume_type_id=644e81a1-0052-4a85-9716-0f4caaa4dbf7)}" {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Creating volume 715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Selected osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48 as target Quobyte volume. {{(pid=82360) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 13:41:12 devstack cinder-volume[82360]: INFO cinder.volume.drivers.remotefs [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] casted to osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab 1073741824 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5115843f-0cc8-4721-b761-ee9dc9a6c2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074b557f-6399-42f5-8e16-65ef9d049359', 'volume_size': 1, 'source_volid': 'f208a08c-4c87-49ff-a0d7-84624980d806', 'source_volstatus': 'available'}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:12 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab 1073741824
Apr 09 13:41:12 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c387451-a871-4580-a3a6-79197a148583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:12 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Volume volume-074b557f-6399-42f5-8e16-65ef9d049359 (074b557f-6399-42f5-8e16-65ef9d049359): created successfully
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c387451-a871-4580-a3a6-79197a148583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:12 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Flow 'volume_create_manager' (ec045129-1eb4-48bb-bf1d-4312c00354a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:12 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-78cd6caa-03d1-4d6b-b687-4a2e0b52f1ef tempest-VolumeDependencyTests-1008572340 None] Created volume successfully.
Apr 09 13:41:13 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab 1073741824" returned: 0 in 0.517s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:13 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab
Apr 09 13:41:13 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-f208a08c-4c87-49ff-a0d7-84624980d806-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-f208a08c-4c87-49ff-a0d7-84624980d806-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:13 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab" returned: 0 in 0.423s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'} {{(pid=82360) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42323250-1e9a-4ad9-8f60-86afc578fcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715189bf-96a0-47ec-aeef-cb603779e4ab', 'volume_size': 1}' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a4871a-ba66-4dfb-864d-7e5bdf4a8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-f208a08c-4c87-49ff-a0d7-84624980d806" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:13 devstack cinder-volume[82360]: INFO cinder.volume.flows.manager.create_volume [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Volume volume-715189bf-96a0-47ec-aeef-cb603779e4ab (715189bf-96a0-47ec-aeef-cb603779e4ab): created successfully
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a4871a-ba66-4dfb-864d-7e5bdf4a8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82360) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Flow 'volume_create_manager' (65d46214-16a6-4455-b5f6-7ee1cf6b82f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82360) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 13:41:13 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-0d5aa782-fa3d-4d1c-b5cc-321559ffe36b tempest-CinderUnicodeTest-1040560343 None] Created volume successfully.
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-f208a08c-4c87-49ff-a0d7-84624980d806" acquired by "delete_volume" :: waited 0.027s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18acfbe-a220-45f4-a1ca-3986763a2ad2]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:13 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:13 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:13 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:14 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.510s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:14 devstack sudo[90881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806
Apr 09 13:41:14 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Creating offline snapshot 48b73339-8ecc-4f84-b0aa-f737c99ae26f of volume 715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[654aaad4-b2a6-4d8a-9668-6cc045e4dd6f]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:14 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab
Apr 09 13:41:14 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:14 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-f208a08c-4c87-49ff-a0d7-84624980d806" returned: 0 in 0.460s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-f208a08c-4c87-49ff-a0d7-84624980d806" released by "delete_volume" :: held 1.005s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Created reservations ['a007e162-d4fa-4a84-b4ee-f84764305094', 'e0f5b9d4-19ad-4e06-a947-dd540f199d9c', '6336de6c-b94d-4c19-9291-5e5596179f91', '4669e4cf-2544-4c70-bead-a9b0a71eafd2'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:14 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:14 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:14 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab" returned: 0 in 0.594s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:14 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f 1G {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:14 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f 1G
Apr 09 13:41:14 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:15 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.418s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:15 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Deleted volume successfully.
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-51bdd426-832d-4c83-b9b4-0f2ce9419d16 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-f208a08c-4c87-49ff-a0d7-84624980d806-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:15 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f 1G" returned: 0 in 0.557s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715189bf-96a0-47ec-aeef-cb603779e4ab -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:15 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715189bf-96a0-47ec-aeef-cb603779e4ab -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f
Apr 09 13:41:15 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-074b557f-6399-42f5-8e16-65ef9d049359-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-074b557f-6399-42f5-8e16-65ef9d049359-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b6e62d-666e-4730-aafb-7edf3117142e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:15 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359
Apr 09 13:41:15 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:15 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715189bf-96a0-47ec-aeef-cb603779e4ab -F qcow2 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f" returned: 0 in 0.529s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:15 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f is being set with open permissions: ugo+rw
Apr 09 13:41:15 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:15 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f
Apr 09 13:41:15 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:16 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359" returned: 0 in 0.501s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:16 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359
Apr 09 13:41:16 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:16 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f" returned: 0 in 0.423s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:16 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info
Apr 09 13:41:16 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:16 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-074b557f-6399-42f5-8e16-65ef9d049359" returned: 0 in 0.413s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-074b557f-6399-42f5-8e16-65ef9d049359" released by "delete_volume" :: held 0.934s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Created reservations ['3a59250e-fb3c-4c88-b10b-f8f2d9db5ae0', '7043429d-4be8-415c-81cb-db2c3e8b7ad3', 'aed2c0fa-46b2-4bd9-8219-7626d6626369', 'be661949-9413-4a20-9e5c-ff717bc7a0d6'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:16 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info" returned: 0 in 0.447s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:16 devstack cinder-volume[82360]: WARNING cinder.volume.drivers.remotefs [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info is being set with open permissions: ugo+rw
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:16 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:16 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:16 devstack sudo[90921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info
Apr 09 13:41:16 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-b96246a8-6784-483e-bc90-63da69c7898a-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-b96246a8-6784-483e-bc90-63da69c7898a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efceb76-b8eb-4b6f-a799-c62927c9968e]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:16 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:16 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a
Apr 09 13:41:16 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:17 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.416s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:17 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Deleted volume successfully.
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-e6c04c4b-0111-4931-a256-f1181f414102 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-074b557f-6399-42f5-8e16-65ef9d049359-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:17 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.info" returned: 0 in 0.440s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.051s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:17 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-1d41f2f7-b13f-4362-95ed-b480ac162425 tempest-CinderUnicodeTest-1040560343 None] Create snapshot completed successfully
Apr 09 13:41:17 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:17 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a
Apr 09 13:41:17 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:17 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-b96246a8-6784-483e-bc90-63da69c7898a" returned: 0 in 0.415s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-quobyte-b96246a8-6784-483e-bc90-63da69c7898a" released by "delete_volume" :: held 0.911s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Created reservations ['fa4bbe37-5b89-49ff-9354-29e10b9877b1', 'c718a59f-07bf-4013-b531-708a31c56aaa', 'f20c2f4e-e289-4823-a50f-7149f4be9168', 'f4a376d2-8de6-4f78-a238-bf0c8469b039'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:17 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:17 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:17 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-48b73339-8ecc-4f84-b0aa-f737c99ae26f-delete_snapshot" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-48b73339-8ecc-4f84-b0aa-f737c99ae26f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" by "delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:18 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-quobyte-48b73339-8ecc-4f84-b0aa-f737c99ae26f" by "_delete_snapshot" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.470s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:18 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Deleted volume successfully.
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-48b73339-8ecc-4f84-b0aa-f737c99ae26f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Deleting offline snapshot 48b73339-8ecc-4f84-b0aa-f737c99ae26f of volume 715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] snapshot_file for this snap is: volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d63d9-3177-4c94-b150-a9beee24f26b]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-756e9c43-e19a-47a0-82b6-8d0ae872b878 tempest-VolumeDependencyTests-1008572340 None] Lock "cinder-b96246a8-6784-483e-bc90-63da69c7898a-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:18 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f
Apr 09 13:41:18 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:18 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f" returned: 0 in 0.563s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.remotefs [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715189bf-96a0-47ec-aeef-cb603779e4ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82360) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f5a00-c9fc-41fa-9733-8b1de9c282ab]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:18 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:18 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab
Apr 09 13:41:18 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:19 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab" returned: 0 in 0.458s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:19 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f
Apr 09 13:41:19 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:19 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f" returned: 0 in 0.432s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:19 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:19 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f
Apr 09 13:41:19 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:20 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab.48b73339-8ecc-4f84-b0aa-f737c99ae26f" returned: 0 in 0.394s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-48b73339-8ecc-4f84-b0aa-f737c99ae26f" released by "_delete_snapshot" :: held 1.917s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" released by "delete_snapshot" :: held 1.941s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Created reservations ['e3c5601e-f9bd-4729-82d2-a5a21eac4cb1', '8ff006b7-4c36-4cf9-87eb-8de4051ac7c4', 'f450bb3f-d2a1-4745-8042-926cc9f098cd', '44e15c6a-7df4-4d6f-a4a7-57ff1abc056f'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:20 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Delete snapshot completed successfully.
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-c3797034-8135-4146-917b-d10e5ae5e3e7 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-48b73339-8ecc-4f84-b0aa-f737c99ae26f-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-715189bf-96a0-47ec-aeef-cb603779e4ab-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-715189bf-96a0-47ec-aeef-cb603779e4ab-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b801b8-f1ab-4c00-acab-04a90008d1cc]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:20 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab
Apr 09 13:41:20 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:20 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab" returned: 0 in 0.479s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:20 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:20 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab
Apr 09 13:41:20 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:21 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-715189bf-96a0-47ec-aeef-cb603779e4ab" returned: 0 in 0.418s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-715189bf-96a0-47ec-aeef-cb603779e4ab" released by "delete_volume" :: held 0.935s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Created reservations ['5b741304-40c4-4224-9867-0b69af435f84', '6529d3c2-09e0-4e30-afc7-294155249452', '41b3de32-5840-4144-b49a-e42acc7693ac', '19f92066-0991-40f1-85fd-b348f4e72d55'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:21 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:21 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7-delete_volume" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "cinder-quobyte-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" by "delete_volume" {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" acquired by "delete_volume" :: waited 0.007s {{(pid=82360) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo.privsep.daemon [-] privsep: reply[c210bb5e-003a-4f42-8583-ba704c7bc0ab]: (4, 'qcow2') {{(pid=83333) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:21 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7
Apr 09 13:41:21 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:21 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.419s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:21 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Deleted volume successfully.
Apr 09 13:41:21 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-da1c6339-1813-4a84-8afe-f6d7f891fe97 tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-715189bf-96a0-47ec-aeef-cb603779e4ab-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:22 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" returned: 0 in 0.474s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7 {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:22 devstack sudo[90970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7
Apr 09 13:41:22 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:22 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f/volume-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" returned: 0 in 0.407s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-quobyte-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7" released by "delete_volume" :: held 0.907s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG cinder.quota [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Created reservations ['f454aef4-3a3c-4b44-9d27-fb932e5d4b90', '6dc25510-08a4-4df0-ab15-5c0b072fdb9f', '86f39013-26ca-424d-a395-45a2e5656262', '6b9bb8fb-b005-4295-8acb-e98409fd56cf'] {{(pid=82360) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48': None} {{(pid=82360) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG cinder.volume.drivers.quobyte [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8bcf52e8-94f5-4fa1-83b2-63c17a9d5d48'] {{(pid=82360) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.lockutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82360) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 13:41:22 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 13:41:22 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f
Apr 09 13:41:22 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 13:41:23 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 09 13:41:23 devstack cinder-volume[82360]: DEBUG oslo_concurrency.processutils [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1dd469c5adbd495cf0a3c2ae8992107f" returned: 0 in 0.485s {{(pid=82360) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 13:41:23 devstack cinder-volume[82360]: DEBUG cinder.manager [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Notifying Schedulers of capabilities ... {{(pid=82360) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 13:41:23 devstack cinder-volume[82360]: INFO cinder.volume.manager [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Deleted volume successfully.
Apr 09 13:41:23 devstack cinder-volume[82360]: DEBUG cinder.coordination [None req-b095d4da-a715-4db2-8ad3-67456a4068ec tempest-CinderUnicodeTest-1040560343 None] Lock "cinder-9d204a7e-2bc4-4424-8b8f-cd1371bda4d7-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82360) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 13:41:32 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:SELECT=160,cinder:DELETE=20,cinder:UPDATE=215,cinder:INSERT=63 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 13:41:33 devstack cinder-volume[82360]: DEBUG dbcounter [-] [82360] Writing DB stats cinder:UPDATE=233,cinder:SELECT=155,cinder:DELETE=17,cinder:INSERT=48 {{(pid=82360) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}